Nov 02 12:00:47 user nova-compute[74534]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74534) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 12:00:47 user nova-compute[74534]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74534) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 12:00:47 user nova-compute[74534]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74534) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 12:00:47 user nova-compute[74534]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.023s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:00:48 user nova-compute[74534]: INFO nova.virt.driver [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 02 12:00:48 user nova-compute[74534]: INFO nova.compute.provider_config [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Acquiring lock "singleton_lock" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Acquired lock "singleton_lock" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Releasing lock "singleton_lock" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Full set of CONF: {{(pid=74534) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ******************************************************************************** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Configuration options gathered from: {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ================================================================================ {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] allow_resize_to_same_host      = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] arq_binding_timeout            = 300 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] backdoor_port                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] backdoor_socket                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] block_device_allocate_retries  = 300 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] block_device_allocate_retries_interval = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cert                           = self.pem {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute_monitors               = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] config_dir                     = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] config_drive_format            = iso9660 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] config_source                  = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] console_host                   = user {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] control_exchange               = nova {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cpu_allocation_ratio           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] daemon                         = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] debug                          = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] default_access_ip_network_name = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] default_availability_zone      = nova {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] default_ephemeral_format       = ext4 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] default_green_pool_size        = 1000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] default_schedule_zone          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] disk_allocation_ratio          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] enable_new_services            = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] enabled_ssl_apis               = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] flat_injected                  = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] force_config_drive             = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] force_raw_images               = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] graceful_shutdown_timeout      = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] heal_instance_info_cache_interval = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] host                           = user {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instance_build_timeout         = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instance_delete_interval       = 300 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instance_name_template         = instance-%08x {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instance_usage_audit           = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instance_usage_audit_period    = month {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] internal_service_availability_zone = internal {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] key                            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] live_migration_retry_count     = 30 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_config_append              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_dir                        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_file                       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_options                    = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_rotate_interval            = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_rotate_interval_type       = days {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] log_rotation_type              = none {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] long_rpc_timeout               = 1800 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] max_concurrent_builds          = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] max_concurrent_live_migrations = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] max_concurrent_snapshots       = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] max_local_block_devices        = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] max_logfile_count              = 30 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] max_logfile_size_mb            = 200 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] maximum_instance_delete_attempts = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] metadata_listen                = 0.0.0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] metadata_listen_port           = 8775 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] metadata_workers               = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] migrate_max_retries            = -1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] mkisofs_cmd                    = genisoimage {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] my_ip                          = 10.0.0.210 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] network_allocate_retries       = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] osapi_compute_listen_port      = 8774 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] osapi_compute_unique_server_name_scope =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] osapi_compute_workers          = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] password_length                = 12 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] periodic_enable                = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] periodic_fuzzy_delay           = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] pointer_model                  = ps2mouse {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] preallocate_images             = none {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] publish_errors                 = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] pybasedir                      = /opt/stack/nova {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ram_allocation_ratio           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rate_limit_burst               = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rate_limit_except_level        = CRITICAL {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rate_limit_interval            = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] reboot_timeout                 = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] reclaim_instance_interval      = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] record                         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] reimage_timeout_per_gb         = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] report_interval                = 120 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rescue_timeout                 = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] reserved_host_cpus             = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] reserved_host_disk_mb          = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] reserved_host_memory_mb        = 512 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] reserved_huge_pages            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] resize_confirm_window          = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] resize_fs_using_block_device   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] resume_guests_state_on_host_boot = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rpc_response_timeout           = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] run_external_periodic_tasks    = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] running_deleted_instance_action = reap {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] running_deleted_instance_timeout = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler_instance_sync_interval = 120 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_down_time              = 720 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] servicegroup_driver            = db {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] shelved_offload_time           = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] shelved_poll_interval          = 3600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] shutdown_timeout               = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] source_is_ipv6                 = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ssl_only                       = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] state_path                     = /opt/stack/data/nova {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] sync_power_state_interval      = 600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] sync_power_state_pool_size     = 1000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] syslog_log_facility            = LOG_USER {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] tempdir                        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] timeout_nbd                    = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] transport_url                  = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] update_resources_interval      = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] use_cow_images                 = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] use_eventlog                   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] use_journal                    = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] use_json                       = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] use_rootwrap_daemon            = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] use_stderr                     = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] use_syslog                     = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vcpu_pin_set                   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plugging_is_fatal          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plugging_timeout           = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] virt_mkfs                      = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] volume_usage_poll_interval     = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] watch_log_file                 = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] web                            = /usr/share/spice-html5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_concurrency.disable_process_locking = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.auth_strategy              = keystone {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.compute_link_prefix        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.dhcp_domain                = novalocal {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.enable_instance_password   = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.glance_link_prefix         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.instance_list_per_project_cells = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.list_records_by_skipping_down_cells = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.local_metadata_per_cell    = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.max_limit                  = 1000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.metadata_cache_expiration  = 15 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.neutron_default_tenant_id  = default {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.use_forwarded_for          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.use_neutron_default_nets   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.vendordata_dynamic_targets = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.vendordata_jsonfile_path   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.backend_argument         = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.config_prefix            = cache.oslo {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.dead_timeout             = 60.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.debug_cache_backend      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.enable_retry_client      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.enable_socket_keepalive  = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.enabled                  = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.expiration_time          = 600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.hashclient_retry_attempts = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_dead_retry      = 300 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_password        =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_sasl_enabled    = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.memcache_username        =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.proxies                  = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.retry_attempts           = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.retry_delay              = 0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.socket_keepalive_count   = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.socket_keepalive_idle    = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.socket_keepalive_interval = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.tls_allowed_ciphers      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.tls_cafile               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.tls_certfile             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.tls_enabled              = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cache.tls_keyfile              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.auth_section            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.auth_type               = password {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.cafile                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.certfile                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.collect_timing          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.cross_az_attach         = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.debug                   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.endpoint_template       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.http_retries            = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.insecure                = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.keyfile                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.os_region_name          = RegionOne {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.split_loggers           = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cinder.timeout                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.cpu_dedicated_set      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.cpu_shared_set         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.image_type_exclude_list = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.resource_provider_association_refresh = 300 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.shutdown_retry_interval = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] conductor.workers              = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] console.allowed_origins        = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] console.ssl_ciphers            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] console.ssl_minimum_version    = default {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] consoleauth.token_ttl          = 600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.cafile                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.certfile                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.collect_timing          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.connect_retries         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.connect_retry_delay     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.endpoint_override       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.insecure                = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.keyfile                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.max_version             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.min_version             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.region_name             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.service_name            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.service_type            = accelerator {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.split_loggers           = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.status_code_retries     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.status_code_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.timeout                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] cyborg.version                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.backend               = sqlalchemy {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.connection            = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.connection_debug      = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.connection_parameters =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.connection_recycle_time = 3600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.connection_trace      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.db_inc_retry_interval = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.db_max_retries        = 20 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.db_max_retry_interval = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.db_retry_interval     = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.max_overflow          = 50 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.max_pool_size         = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.max_retries           = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.mysql_wsrep_sync_wait = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.pool_timeout          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.retry_interval        = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.slave_connection      = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] database.sqlite_synchronous    = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.backend           = sqlalchemy {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.connection        = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.connection_debug  = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.connection_parameters =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.connection_recycle_time = 3600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.connection_trace  = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.db_inc_retry_interval = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.db_max_retries    = 20 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.db_max_retry_interval = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.db_retry_interval = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.max_overflow      = 50 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.max_pool_size     = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.max_retries       = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.pool_timeout      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.retry_interval    = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.slave_connection  = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] api_database.sqlite_synchronous = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] devices.enabled_mdev_types     = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ephemeral_storage_encryption.enabled = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.api_servers             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.cafile                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.certfile                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.collect_timing          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.connect_retries         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.connect_retry_delay     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.debug                   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.default_trusted_certificate_ids = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.enable_certificate_validation = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.enable_rbd_download     = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.endpoint_override       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.insecure                = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.keyfile                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.max_version             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.min_version             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.num_retries             = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.rbd_ceph_conf           =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.rbd_connect_timeout     = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.rbd_pool                =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.rbd_user                =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.region_name             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.service_name            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.service_type            = image {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.split_loggers           = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.status_code_retries     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.status_code_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.timeout                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.verify_glance_signatures = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] glance.version                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] guestfs.debug                  = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.config_drive_cdrom      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.config_drive_inject_password = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.enable_remotefx         = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.instances_path_share    =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.limit_cpu_features      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.use_multipath_io        = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.vswitch_name            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] mks.enabled                    = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] image_cache.manager_interval   = 2400 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] image_cache.precache_concurrency = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] image_cache.remove_unused_base_images = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] image_cache.subdirectory_name  = _base {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.api_max_retries         = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.api_retry_interval      = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.auth_section            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.auth_type               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.cafile                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.certfile                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.collect_timing          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.conductor_group         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.connect_retries         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.connect_retry_delay     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.endpoint_override       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.insecure                = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.keyfile                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.max_version             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.min_version             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.peer_list               = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.region_name             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.serial_console_state_timeout = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.service_name            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.service_type            = baremetal {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.split_loggers           = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.status_code_retries     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.status_code_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.timeout                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ironic.version                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] key_manager.fixed_key          = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.barbican_api_version  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.barbican_endpoint     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.barbican_endpoint_type = public {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.barbican_region_name  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.cafile                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.certfile              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.collect_timing        = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.insecure              = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.keyfile               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.number_of_retries     = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.retry_delay           = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.send_service_user_token = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.split_loggers         = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.timeout               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.verify_ssl            = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican.verify_ssl_path       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.auth_section = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.auth_type = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.cafile   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.certfile = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.collect_timing = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.insecure = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.keyfile  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.split_loggers = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] barbican_service_user.timeout  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.approle_role_id          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.approle_secret_id        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.cafile                   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.certfile                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.collect_timing           = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.insecure                 = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.keyfile                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.kv_mountpoint            = secret {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.kv_path                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.kv_version               = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.namespace                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.root_token_id            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.split_loggers            = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.ssl_ca_crt_file          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.timeout                  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.use_ssl                  = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.auth_section          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.auth_type             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.cafile                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.certfile              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.collect_timing        = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.connect_retries       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.connect_retry_delay   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.endpoint_override     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.insecure              = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.keyfile               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.max_version           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.min_version           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.region_name           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.service_name          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.service_type          = identity {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.split_loggers         = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.status_code_retries   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.status_code_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.timeout               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] keystone.version               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.connection_uri         =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.cpu_mode               = custom {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: WARNING oslo_config.cfg [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.cpu_power_governor_high = performance {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.cpu_power_management   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.device_detach_attempts = 8 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.device_detach_timeout  = 20 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.disk_cachemodes        = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.disk_prefix            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.enabled_perf_events    = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.file_backed_memory     = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.gid_maps               = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.hw_disk_discard        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.hw_machine_type        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.images_rbd_pool        = rbd {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.images_type            = default {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.images_volume_group    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.inject_key             = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.inject_partition       = -2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.inject_password        = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.iscsi_iface            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.iser_use_multipath     = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_downtime = 500 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_inbound_addr = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_scheme  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_timeout_action = abort {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_tunnelled = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: WARNING oslo_config.cfg [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 02 12:00:48 user nova-compute[74534]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 02 12:00:48 user nova-compute[74534]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 02 12:00:48 user nova-compute[74534]: and ``live_migration_inbound_addr`` respectively.
Nov 02 12:00:48 user nova-compute[74534]: ).  Its value may be silently ignored in the future.
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.live_migration_with_native_tls = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.max_queues             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.nfs_mount_options      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.num_pcie_ports         = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.pmem_namespaces        = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.quobyte_client_cfg     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rbd_secret_uuid        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rbd_user               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rescue_image_id        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rescue_kernel_id       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.rx_queue_size          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.smbfs_mount_options    =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.snapshot_compression   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.snapshot_image_format  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.sparse_logical_volumes = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.swtpm_enabled          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.swtpm_group            = tss {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.swtpm_user             = tss {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.sysinfo_serial         = unique {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.tb_cache_size          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.tx_queue_size          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.uid_maps               = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.use_virtio_for_bridges = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.virt_type              = kvm {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.volume_clear           = zero {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.volume_clear_size      = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.volume_use_multipath   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.vzstorage_cache_path   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.auth_section           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.auth_type              = password {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.cafile                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.certfile               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.collect_timing         = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.connect_retries        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.connect_retry_delay    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.default_floating_pool  = public {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.endpoint_override      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.extension_sync_interval = 600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.http_retries           = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.insecure               = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.keyfile                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.max_version            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.min_version            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.ovs_bridge             = br-int {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.physnets               = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.region_name            = RegionOne {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.service_metadata_proxy = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.service_name           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.service_type           = network {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.split_loggers          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.status_code_retries    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.status_code_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.timeout                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] neutron.version                = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] notifications.bdms_in_notifications = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] notifications.default_level    = INFO {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] notifications.notification_format = unversioned {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] notifications.notify_on_state_change = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] pci.alias                      = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] pci.device_spec                = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] pci.report_in_placement        = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.auth_section         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.auth_type            = password {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.cafile               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.certfile             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.collect_timing       = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.connect_retries      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.connect_retry_delay  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.default_domain_id    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.default_domain_name  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.domain_id            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.domain_name          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.endpoint_override    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.insecure             = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.keyfile              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.max_version          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.min_version          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.password             = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.project_domain_id    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.project_domain_name  = Default {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.project_id           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.project_name         = service {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.region_name          = RegionOne {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.service_name         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.service_type         = placement {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.split_loggers        = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.status_code_retries  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.status_code_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.system_scope         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.timeout              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.trust_id             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.user_domain_id       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.user_domain_name     = Default {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.user_id              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.username             = placement {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] placement.version              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.cores                    = 20 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.count_usage_from_placement = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.injected_file_content_bytes = 10240 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.injected_file_path_length = 255 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.injected_files           = 5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.instances                = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.key_pairs                = 100 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.metadata_items           = 128 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.ram                      = 51200 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.recheck_quota            = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.server_group_members     = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] quota.server_groups            = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rdp.enabled                    = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.image_metadata_prefilter = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.max_attempts         = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.max_placement_results = 1000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] scheduler.workers              = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.host_subset_size = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.isolated_hosts = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.isolated_images = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.pci_in_placement = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.track_instance_changes = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] metrics.required               = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] metrics.weight_multiplier      = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] metrics.weight_setting         = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] serial_console.enabled         = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] serial_console.port_range      = 10000:20000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] serial_console.serialproxy_port = 6083 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.auth_section      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.auth_type         = password {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.cafile            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.certfile          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.collect_timing    = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.insecure          = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.keyfile           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.send_service_user_token = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.split_loggers     = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] service_user.timeout           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.agent_enabled            = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.enabled                  = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.html5proxy_port          = 6082 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.image_compression        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.jpeg_compression         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.playback_compression     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.server_listen            = 127.0.0.1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.streaming_mode           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] spice.zlib_compression         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] upgrade_levels.baseapi         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] upgrade_levels.cert            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] upgrade_levels.compute         = auto {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] upgrade_levels.conductor       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] upgrade_levels.scheduler       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.cafile = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.certfile = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.insecure = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vendordata_dynamic_auth.timeout = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.api_retry_count         = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.ca_file                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.cache_prefix            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.cluster_name            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.connection_pool_size    = 10 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.console_delay_seconds   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.datastore_regex         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.host_ip                 = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.host_password           = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.host_port               = 443 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.host_username           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.insecure                = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.integration_bridge      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.maximum_objects         = 100 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.pbm_default_policy      = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.pbm_enabled             = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.pbm_wsdl_location       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.serial_port_proxy_uri   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.serial_port_service_uri = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.task_poll_interval      = 0.5 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.use_linked_clone        = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.vnc_keymap              = en-us {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.vnc_port                = 5900 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vmware.vnc_port_total          = 10000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.auth_schemes               = ['none'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.enabled                    = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.novncproxy_port            = 6080 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.vencrypt_ca_certs          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.vencrypt_client_cert       = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vnc.vencrypt_client_key        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.disable_rootwrap   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.enable_numa_live_migration = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.libvirt_disable_apic = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.client_socket_timeout     = 900 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.default_pool_size         = 1000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.keep_alive                = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.max_header_line           = 16384 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.ssl_ca_file               = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.ssl_cert_file             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.ssl_key_file              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.tcp_keepidle              = 600 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] zvm.ca_file                    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] zvm.cloud_connector_url        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] zvm.reachable_timeout          = 300 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.enforce_new_defaults = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.enforce_scope      = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.policy_default_rule = default {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.connection_string     = messaging:// {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.enabled               = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.es_doc_type           = notification {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.es_scroll_size        = 10000 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.es_scroll_time        = 2m {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.filter_error_trace    = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.hmac_keys             = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.sentinel_service_name = mymaster {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.socket_timeout        = 0.1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.trace_requests        = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler.trace_sqlalchemy      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler_jaeger.process_tags   = {} {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler_jaeger.service_name_prefix = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] profiler_otlp.service_name_prefix = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] remote_debug.host              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] remote_debug.port              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_notifications.retry = -1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.auth_section        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.auth_type           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.cafile              = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.certfile            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.collect_timing      = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.connect_retries     = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.connect_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.endpoint_id         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.endpoint_override   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.insecure            = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.keyfile             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.max_version         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.min_version         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.region_name         = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.service_name        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.service_type        = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.split_loggers       = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.status_code_retries = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.status_code_retry_delay = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.timeout             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.valid_interfaces    = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_limit.version             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_reports.file_event_handler = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] oslo_reports.log_dir           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_ovs_privileged.group  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] vif_plug_ovs_privileged.user   = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_ovs.isolate_vif         = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] os_brick.lock_path             = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] privsep_osbrick.capabilities   = [21] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] privsep_osbrick.group          = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] privsep_osbrick.helper_command = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] privsep_osbrick.user           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] nova_sys_admin.group           = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] nova_sys_admin.helper_command  = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] nova_sys_admin.user            = None {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG oslo_service.service [None req-d70763a5-ac0e-4bec-ba8d-9626bb9de355 None None] ******************************************************************************** {{(pid=74534) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 02 12:00:48 user nova-compute[74534]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 02 12:00:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Connecting to libvirt: qemu:///system {{(pid=74534) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe1a121f190> {{(pid=74534) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 02 12:00:48 user nova-compute[74534]: libvirt:  error : internal error: could not initialize domain event timer
Nov 02 12:00:48 user nova-compute[74534]: WARNING nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 02 12:00:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe1a121f190> {{(pid=74534) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Starting native event thread {{(pid=74534) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Starting green dispatch thread {{(pid=74534) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 02 12:00:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Starting connection event dispatch thread {{(pid=74534) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 02 12:00:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Connection event '1' reason 'None'
Nov 02 12:00:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 12:00:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.mount [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Initialising _HostMountState generation 0 {{(pid=74534) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 02 12:00:55 user nova-compute[74534]: INFO nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host capabilities <capabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <host>
Nov 02 12:00:55 user nova-compute[74534]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 02 12:00:55 user nova-compute[74534]:     <cpu>
Nov 02 12:00:55 user nova-compute[74534]:       <arch>x86_64</arch>
Nov 02 12:00:55 user nova-compute[74534]:       <model>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <microcode version='1070'/>
Nov 02 12:00:55 user nova-compute[74534]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 02 12:00:55 user nova-compute[74534]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='osxsave'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='invtsc'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='rsba'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature name='skip-l1dfl-vmentry'/>
Nov 02 12:00:55 user nova-compute[74534]:       <pages unit='KiB' size='4'/>
Nov 02 12:00:55 user nova-compute[74534]:       <pages unit='KiB' size='2048'/>
Nov 02 12:00:55 user nova-compute[74534]:     </cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <power_management>
Nov 02 12:00:55 user nova-compute[74534]:       <suspend_mem/>
Nov 02 12:00:55 user nova-compute[74534]:       <suspend_disk/>
Nov 02 12:00:55 user nova-compute[74534]:       <suspend_hybrid/>
Nov 02 12:00:55 user nova-compute[74534]:     </power_management>
Nov 02 12:00:55 user nova-compute[74534]:     <iommu support='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     <migration_features>
Nov 02 12:00:55 user nova-compute[74534]:       <live/>
Nov 02 12:00:55 user nova-compute[74534]:       <uri_transports>
Nov 02 12:00:55 user nova-compute[74534]:         <uri_transport>tcp</uri_transport>
Nov 02 12:00:55 user nova-compute[74534]:         <uri_transport>rdma</uri_transport>
Nov 02 12:00:55 user nova-compute[74534]:       </uri_transports>
Nov 02 12:00:55 user nova-compute[74534]:     </migration_features>
Nov 02 12:00:55 user nova-compute[74534]:     <topology>
Nov 02 12:00:55 user nova-compute[74534]:       <cells num='2'>
Nov 02 12:00:55 user nova-compute[74534]:         <cell id='0'>
Nov 02 12:00:55 user nova-compute[74534]:           <memory unit='KiB'>8189224</memory>
Nov 02 12:00:55 user nova-compute[74534]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 02 12:00:55 user nova-compute[74534]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 12:00:55 user nova-compute[74534]:           <distances>
Nov 02 12:00:55 user nova-compute[74534]:             <sibling id='0' value='10'/>
Nov 02 12:00:55 user nova-compute[74534]:             <sibling id='1' value='20'/>
Nov 02 12:00:55 user nova-compute[74534]:           </distances>
Nov 02 12:00:55 user nova-compute[74534]:           <cpus num='6'>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 02 12:00:55 user nova-compute[74534]:           </cpus>
Nov 02 12:00:55 user nova-compute[74534]:         </cell>
Nov 02 12:00:55 user nova-compute[74534]:         <cell id='1'>
Nov 02 12:00:55 user nova-compute[74534]:           <memory unit='KiB'>8206460</memory>
Nov 02 12:00:55 user nova-compute[74534]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 02 12:00:55 user nova-compute[74534]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 12:00:55 user nova-compute[74534]:           <distances>
Nov 02 12:00:55 user nova-compute[74534]:             <sibling id='0' value='20'/>
Nov 02 12:00:55 user nova-compute[74534]:             <sibling id='1' value='10'/>
Nov 02 12:00:55 user nova-compute[74534]:           </distances>
Nov 02 12:00:55 user nova-compute[74534]:           <cpus num='6'>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 02 12:00:55 user nova-compute[74534]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 02 12:00:55 user nova-compute[74534]:           </cpus>
Nov 02 12:00:55 user nova-compute[74534]:         </cell>
Nov 02 12:00:55 user nova-compute[74534]:       </cells>
Nov 02 12:00:55 user nova-compute[74534]:     </topology>
Nov 02 12:00:55 user nova-compute[74534]:     <cache>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 02 12:00:55 user nova-compute[74534]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 02 12:00:55 user nova-compute[74534]:     </cache>
Nov 02 12:00:55 user nova-compute[74534]:     <secmodel>
Nov 02 12:00:55 user nova-compute[74534]:       <model>apparmor</model>
Nov 02 12:00:55 user nova-compute[74534]:       <doi>0</doi>
Nov 02 12:00:55 user nova-compute[74534]:     </secmodel>
Nov 02 12:00:55 user nova-compute[74534]:     <secmodel>
Nov 02 12:00:55 user nova-compute[74534]:       <model>dac</model>
Nov 02 12:00:55 user nova-compute[74534]:       <doi>0</doi>
Nov 02 12:00:55 user nova-compute[74534]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 02 12:00:55 user nova-compute[74534]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 02 12:00:55 user nova-compute[74534]:     </secmodel>
Nov 02 12:00:55 user nova-compute[74534]:   </host>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='alpha'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>clipper</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='armv6l'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>spitz</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>nuri</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>kzm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sx1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>z2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>tosa</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>n810</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>n800</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>terrier</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>midway</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>microbit</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>verdex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>highbank</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>akita</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>connex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>collie</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='armv7l'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>spitz</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>nuri</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>kzm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sx1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>z2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>tosa</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>n810</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>n800</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>terrier</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>midway</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>microbit</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>verdex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>highbank</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>akita</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>connex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>collie</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='aarch64'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>spitz</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>nuri</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>kzm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sx1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>z2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>tosa</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>n810</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>n800</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>terrier</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>midway</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>microbit</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>verdex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>raspi3b</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>highbank</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>akita</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>connex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>collie</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <acpi default='on' toggle='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='cris'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='i686'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>isapc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>microvm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='kvm'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <pae/>
Nov 02 12:00:55 user nova-compute[74534]:       <nonpae/>
Nov 02 12:00:55 user nova-compute[74534]:       <acpi default='on' toggle='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:       <apic default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='m68k'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>an5206</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>q800</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>next-cube</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='microblaze'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='microblazeel'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='mips'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='16'>malta</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='mipsel'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='16'>malta</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='mips64'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='16'>malta</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>pica61</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>magnum</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='mips64el'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='16'>malta</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>pica61</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>magnum</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='16'>boston</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='ppc'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mac99</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>40p</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>taihu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='ppc64'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>taihu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>40p</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mac99</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='ppc64le'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>taihu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>40p</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>mac99</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='riscv32'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='8'>spike</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>opentitan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='8'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='riscv64'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='8'>spike</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>shakti_c</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='8'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='s390x'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='sh4'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>shix</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>r2d</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='sh4eb'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>shix</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>r2d</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='sparc'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>SS-5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>SS-20</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>LX</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>SS-4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>SS-10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>Voyager</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='sparc64'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sun4u</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>niagara</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>sun4v</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='x86_64'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>64</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='1'>isapc</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>microvm</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='kvm'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <acpi default='on' toggle='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:       <apic default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='xtensa'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>sim</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>kc705</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>ml605</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx200</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx60</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]:   <guest>
Nov 02 12:00:55 user nova-compute[74534]:     <os_type>hvm</os_type>
Nov 02 12:00:55 user nova-compute[74534]:     <arch name='xtensaeb'>
Nov 02 12:00:55 user nova-compute[74534]:       <wordsize>32</wordsize>
Nov 02 12:00:55 user nova-compute[74534]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='4'>sim</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>kc705</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>ml605</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>virt</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx200</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>lx60</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 12:00:55 user nova-compute[74534]:       <domain type='qemu'/>
Nov 02 12:00:55 user nova-compute[74534]:     </arch>
Nov 02 12:00:55 user nova-compute[74534]:     <features>
Nov 02 12:00:55 user nova-compute[74534]:       <cpuselection/>
Nov 02 12:00:55 user nova-compute[74534]:       <deviceboot/>
Nov 02 12:00:55 user nova-compute[74534]:       <disksnapshot default='on' toggle='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     </features>
Nov 02 12:00:55 user nova-compute[74534]:   </guest>
Nov 02 12:00:55 user nova-compute[74534]: </capabilities>
Nov 02 12:00:55 user nova-compute[74534]: 
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 02 12:00:55 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 12:00:55 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:55 user nova-compute[74534]:   <machine>pc-q35-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:   <arch>i686</arch>
Nov 02 12:00:55 user nova-compute[74534]:   <vcpu max='288'/>
Nov 02 12:00:55 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='firmware'/>
Nov 02 12:00:55 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </loader>
Nov 02 12:00:55 user nova-compute[74534]:   </os>
Nov 02 12:00:55 user nova-compute[74534]:   <cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='lm'/>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>kvm64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>core2duo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Penryn</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G1</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Conroe</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:   </cpu>
Nov 02 12:00:55 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:55 user nova-compute[74534]:   <devices>
Nov 02 12:00:55 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </disk>
Nov 02 12:00:55 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </graphics>
Nov 02 12:00:55 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </video>
Nov 02 12:00:55 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:55 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:55 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </rng>
Nov 02 12:00:55 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:55 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </tpm>
Nov 02 12:00:55 user nova-compute[74534]:   </devices>
Nov 02 12:00:55 user nova-compute[74534]:   <features>
Nov 02 12:00:55 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:   </features>
Nov 02 12:00:55 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 02 12:00:55 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 12:00:55 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:55 user nova-compute[74534]:   <machine>pc-i440fx-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:   <arch>i686</arch>
Nov 02 12:00:55 user nova-compute[74534]:   <vcpu max='255'/>
Nov 02 12:00:55 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='firmware'/>
Nov 02 12:00:55 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </loader>
Nov 02 12:00:55 user nova-compute[74534]:   </os>
Nov 02 12:00:55 user nova-compute[74534]:   <cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='lm'/>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>kvm64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>core2duo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Penryn</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G1</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Conroe</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:   </cpu>
Nov 02 12:00:55 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:55 user nova-compute[74534]:   <devices>
Nov 02 12:00:55 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ide</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </disk>
Nov 02 12:00:55 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </graphics>
Nov 02 12:00:55 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </video>
Nov 02 12:00:55 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:55 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:55 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </rng>
Nov 02 12:00:55 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:55 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </tpm>
Nov 02 12:00:55 user nova-compute[74534]:   </devices>
Nov 02 12:00:55 user nova-compute[74534]:   <features>
Nov 02 12:00:55 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:   </features>
Nov 02 12:00:55 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 02 12:00:55 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 12:00:55 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:55 user nova-compute[74534]:   <machine>pc-i440fx-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:   <arch>i686</arch>
Nov 02 12:00:55 user nova-compute[74534]:   <vcpu max='255'/>
Nov 02 12:00:55 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='firmware'/>
Nov 02 12:00:55 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </loader>
Nov 02 12:00:55 user nova-compute[74534]:   </os>
Nov 02 12:00:55 user nova-compute[74534]:   <cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='lm'/>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>kvm64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>core2duo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Penryn</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G1</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Conroe</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:   </cpu>
Nov 02 12:00:55 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:55 user nova-compute[74534]:   <devices>
Nov 02 12:00:55 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ide</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </disk>
Nov 02 12:00:55 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </graphics>
Nov 02 12:00:55 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </video>
Nov 02 12:00:55 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:55 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:55 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </rng>
Nov 02 12:00:55 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:55 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </tpm>
Nov 02 12:00:55 user nova-compute[74534]:   </devices>
Nov 02 12:00:55 user nova-compute[74534]:   <features>
Nov 02 12:00:55 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:   </features>
Nov 02 12:00:55 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 02 12:00:55 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 12:00:55 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:55 user nova-compute[74534]:   <machine>pc-q35-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:   <arch>i686</arch>
Nov 02 12:00:55 user nova-compute[74534]:   <vcpu max='288'/>
Nov 02 12:00:55 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='firmware'/>
Nov 02 12:00:55 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </loader>
Nov 02 12:00:55 user nova-compute[74534]:   </os>
Nov 02 12:00:55 user nova-compute[74534]:   <cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='lm'/>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>kvm64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>core2duo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Westmere</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Penryn</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G1</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Nehalem</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Conroe</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:   </cpu>
Nov 02 12:00:55 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:55 user nova-compute[74534]:   <devices>
Nov 02 12:00:55 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </disk>
Nov 02 12:00:55 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </graphics>
Nov 02 12:00:55 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </video>
Nov 02 12:00:55 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:55 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:55 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </rng>
Nov 02 12:00:55 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:55 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </tpm>
Nov 02 12:00:55 user nova-compute[74534]:   </devices>
Nov 02 12:00:55 user nova-compute[74534]:   <features>
Nov 02 12:00:55 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:   </features>
Nov 02 12:00:55 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 02 12:00:55 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 12:00:55 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:55 user nova-compute[74534]:   <machine>pc-q35-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:   <arch>x86_64</arch>
Nov 02 12:00:55 user nova-compute[74534]:   <vcpu max='288'/>
Nov 02 12:00:55 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='firmware'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>efi</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </loader>
Nov 02 12:00:55 user nova-compute[74534]:   </os>
Nov 02 12:00:55 user nova-compute[74534]:   <cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='invtsc'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='rsba'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>core2duo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Westmere</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Penryn</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Opteron_G1</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Nehalem</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Conroe</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:   </cpu>
Nov 02 12:00:55 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:55 user nova-compute[74534]:   <devices>
Nov 02 12:00:55 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </disk>
Nov 02 12:00:55 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </graphics>
Nov 02 12:00:55 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </video>
Nov 02 12:00:55 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:55 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:55 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </rng>
Nov 02 12:00:55 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:55 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </tpm>
Nov 02 12:00:55 user nova-compute[74534]:   </devices>
Nov 02 12:00:55 user nova-compute[74534]:   <features>
Nov 02 12:00:55 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:   </features>
Nov 02 12:00:55 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 02 12:00:55 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 12:00:55 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:55 user nova-compute[74534]:   <machine>pc-i440fx-6.2</machine>
Nov 02 12:00:55 user nova-compute[74534]:   <arch>x86_64</arch>
Nov 02 12:00:55 user nova-compute[74534]:   <vcpu max='255'/>
Nov 02 12:00:55 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='firmware'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>efi</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </loader>
Nov 02 12:00:55 user nova-compute[74534]:   </os>
Nov 02 12:00:55 user nova-compute[74534]:   <cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='invtsc'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='rsba'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>core2duo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Westmere</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Penryn</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Opteron_G1</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Nehalem</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Conroe</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:   </cpu>
Nov 02 12:00:55 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:55 user nova-compute[74534]:   <devices>
Nov 02 12:00:55 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ide</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </disk>
Nov 02 12:00:55 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </graphics>
Nov 02 12:00:55 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </video>
Nov 02 12:00:55 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:55 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:55 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </rng>
Nov 02 12:00:55 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:55 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </tpm>
Nov 02 12:00:55 user nova-compute[74534]:   </devices>
Nov 02 12:00:55 user nova-compute[74534]:   <features>
Nov 02 12:00:55 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:55 user nova-compute[74534]:   </features>
Nov 02 12:00:55 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 02 12:00:55 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:55 user nova-compute[74534]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 12:00:55 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:55 user nova-compute[74534]:   <machine>pc-i440fx-jammy</machine>
Nov 02 12:00:55 user nova-compute[74534]:   <arch>x86_64</arch>
Nov 02 12:00:55 user nova-compute[74534]:   <vcpu max='255'/>
Nov 02 12:00:55 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:55 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='firmware'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>efi</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </loader>
Nov 02 12:00:55 user nova-compute[74534]:   </os>
Nov 02 12:00:55 user nova-compute[74534]:   <cpu>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='invtsc'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='rsba'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:55 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm64</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>core2duo</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Westmere</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Penryn</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Opteron_G1</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Nehalem</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>Conroe</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:55 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:55 user nova-compute[74534]:     </mode>
Nov 02 12:00:55 user nova-compute[74534]:   </cpu>
Nov 02 12:00:55 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:55 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:55 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:55 user nova-compute[74534]:     </enum>
Nov 02 12:00:55 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:55 user nova-compute[74534]:   <devices>
Nov 02 12:00:55 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>ide</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:55 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:55 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </disk>
Nov 02 12:00:56 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </graphics>
Nov 02 12:00:56 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </video>
Nov 02 12:00:56 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:56 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:56 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </rng>
Nov 02 12:00:56 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:56 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </tpm>
Nov 02 12:00:56 user nova-compute[74534]:   </devices>
Nov 02 12:00:56 user nova-compute[74534]:   <features>
Nov 02 12:00:56 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:56 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:56 user nova-compute[74534]:   </features>
Nov 02 12:00:56 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:56 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 02 12:00:56 user nova-compute[74534]: <domainCapabilities>
Nov 02 12:00:56 user nova-compute[74534]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 12:00:56 user nova-compute[74534]:   <domain>kvm</domain>
Nov 02 12:00:56 user nova-compute[74534]:   <machine>pc-q35-6.2</machine>
Nov 02 12:00:56 user nova-compute[74534]:   <arch>x86_64</arch>
Nov 02 12:00:56 user nova-compute[74534]:   <vcpu max='288'/>
Nov 02 12:00:56 user nova-compute[74534]:   <iothreads supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:   <os supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:     <enum name='firmware'>
Nov 02 12:00:56 user nova-compute[74534]:       <value>efi</value>
Nov 02 12:00:56 user nova-compute[74534]:     </enum>
Nov 02 12:00:56 user nova-compute[74534]:     <loader supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 12:00:56 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 12:00:56 user nova-compute[74534]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>rom</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>pflash</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='readonly'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='secure'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>yes</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>no</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </loader>
Nov 02 12:00:56 user nova-compute[74534]:   </os>
Nov 02 12:00:56 user nova-compute[74534]:   <cpu>
Nov 02 12:00:56 user nova-compute[74534]:     <mode name='host-passthrough' supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='hostPassthroughMigratable'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </mode>
Nov 02 12:00:56 user nova-compute[74534]:     <mode name='maximum' supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='maximumMigratable'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>on</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>off</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </mode>
Nov 02 12:00:56 user nova-compute[74534]:     <mode name='host-model' supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <vendor>Intel</vendor>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='ss'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='vmx'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='pcid'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='hypervisor'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='arat'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='umip'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='md-clear'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='stibp'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='ssbd'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='invtsc'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='ibpb'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='ibrs'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='amd-stibp'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='rsba'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='disable' name='erms'/>
Nov 02 12:00:56 user nova-compute[74534]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 12:00:56 user nova-compute[74534]:     </mode>
Nov 02 12:00:56 user nova-compute[74534]:     <mode name='custom' supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>qemu64</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>qemu32</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>phenom</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>pentium3</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>pentium2</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>pentium</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>n270</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>kvm64</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>kvm32</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>coreduo</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>core2duo</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>athlon</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>Westmere</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Snowridge</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Skylake-Server</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Skylake-Client</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>SandyBridge</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>Penryn</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Opteron_G5</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Opteron_G4</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Opteron_G3</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Opteron_G2</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>Opteron_G1</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>Nehalem</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>IvyBridge</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Icelake-Server</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Haswell</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>EPYC-Rome</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>EPYC-Milan</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>EPYC</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Dhyana</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Cooperlake</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>Conroe</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='no'>Broadwell</model>
Nov 02 12:00:56 user nova-compute[74534]:       <model usable='yes'>486</model>
Nov 02 12:00:56 user nova-compute[74534]:     </mode>
Nov 02 12:00:56 user nova-compute[74534]:   </cpu>
Nov 02 12:00:56 user nova-compute[74534]:   <memoryBacking supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:     <enum name='sourceType'>
Nov 02 12:00:56 user nova-compute[74534]:       <value>file</value>
Nov 02 12:00:56 user nova-compute[74534]:       <value>anonymous</value>
Nov 02 12:00:56 user nova-compute[74534]:       <value>memfd</value>
Nov 02 12:00:56 user nova-compute[74534]:     </enum>
Nov 02 12:00:56 user nova-compute[74534]:   </memoryBacking>
Nov 02 12:00:56 user nova-compute[74534]:   <devices>
Nov 02 12:00:56 user nova-compute[74534]:     <disk supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='diskDevice'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>disk</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>cdrom</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>floppy</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>lun</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='bus'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>fdc</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>sata</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </disk>
Nov 02 12:00:56 user nova-compute[74534]:     <graphics supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='type'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>sdl</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>vnc</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>spice</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>egl-headless</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </graphics>
Nov 02 12:00:56 user nova-compute[74534]:     <video supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='modelType'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>vga</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>cirrus</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>vmvga</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>qxl</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>none</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>bochs</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>ramfb</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </video>
Nov 02 12:00:56 user nova-compute[74534]:     <hostdev supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='mode'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>subsystem</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='startupPolicy'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>default</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>mandatory</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>requisite</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>optional</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='subsysType'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>usb</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>pci</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>scsi</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='capsType'/>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='pciBackend'/>
Nov 02 12:00:56 user nova-compute[74534]:     </hostdev>
Nov 02 12:00:56 user nova-compute[74534]:     <rng supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio-transitional</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtio-non-transitional</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>random</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>egd</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>builtin</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </rng>
Nov 02 12:00:56 user nova-compute[74534]:     <filesystem supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='driverType'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>path</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>handle</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>virtiofs</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </filesystem>
Nov 02 12:00:56 user nova-compute[74534]:     <tpm supported='yes'>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='model'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>tpm-tis</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>tpm-crb</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:       <enum name='backendModel'>
Nov 02 12:00:56 user nova-compute[74534]:         <value>passthrough</value>
Nov 02 12:00:56 user nova-compute[74534]:         <value>emulator</value>
Nov 02 12:00:56 user nova-compute[74534]:       </enum>
Nov 02 12:00:56 user nova-compute[74534]:     </tpm>
Nov 02 12:00:56 user nova-compute[74534]:   </devices>
Nov 02 12:00:56 user nova-compute[74534]:   <features>
Nov 02 12:00:56 user nova-compute[74534]:     <gic supported='no'/>
Nov 02 12:00:56 user nova-compute[74534]:     <vmcoreinfo supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <genid supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <backingStoreInput supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <backup supported='yes'/>
Nov 02 12:00:56 user nova-compute[74534]:     <sev supported='no'/>
Nov 02 12:00:56 user nova-compute[74534]:   </features>
Nov 02 12:00:56 user nova-compute[74534]: </domainCapabilities>
Nov 02 12:00:56 user nova-compute[74534]:  {{(pid=74534) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74534) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74534) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Checking secure boot support for host arch (x86_64) {{(pid=74534) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 12:00:56 user nova-compute[74534]: INFO nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Secure Boot support detected
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] cpu compare xml: <cpu match="exact">
Nov 02 12:00:56 user nova-compute[74534]:   <model>Nehalem</model>
Nov 02 12:00:56 user nova-compute[74534]: </cpu>
Nov 02 12:00:56 user nova-compute[74534]:  {{(pid=74534) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 02 12:00:56 user nova-compute[74534]: INFO nova.virt.node [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Generated node identity 3caa4a25-2a24-4d3a-8922-6168a63361d5
Nov 02 12:00:56 user nova-compute[74534]: INFO nova.virt.node [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Wrote node identity 3caa4a25-2a24-4d3a-8922-6168a63361d5 to /opt/stack/data/nova/compute_id
Nov 02 12:00:56 user nova-compute[74534]: WARNING nova.compute.manager [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Compute nodes ['3caa4a25-2a24-4d3a-8922-6168a63361d5'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 02 12:00:56 user nova-compute[74534]: INFO nova.compute.manager [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 02 12:00:56 user nova-compute[74534]: WARNING nova.compute.manager [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 12:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:00:56 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:00:56 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Hypervisor/Node resource view: name=user free_ram=10945MB free_disk=26.158279418945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:00:56 user nova-compute[74534]: WARNING nova.compute.resource_tracker [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] No compute node record for user:3caa4a25-2a24-4d3a-8922-6168a63361d5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3caa4a25-2a24-4d3a-8922-6168a63361d5 could not be found.
Nov 02 12:00:56 user nova-compute[74534]: INFO nova.compute.resource_tracker [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Compute node record created for user:user with uuid: 3caa4a25-2a24-4d3a-8922-6168a63361d5
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:00:56 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] [req-f1c08034-1d4b-43d8-81dc-53d9bbc7d7f2] Created resource provider record via placement API for resource provider with UUID 3caa4a25-2a24-4d3a-8922-6168a63361d5 and name user.
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74534) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 02 12:00:56 user nova-compute[74534]: INFO nova.virt.libvirt.host [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] kernel doesn't support AMD SEV
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Libvirt baseline CPU <cpu>
Nov 02 12:00:56 user nova-compute[74534]:   <arch>x86_64</arch>
Nov 02 12:00:56 user nova-compute[74534]:   <model>Nehalem</model>
Nov 02 12:00:56 user nova-compute[74534]:   <vendor>Intel</vendor>
Nov 02 12:00:56 user nova-compute[74534]:   <topology sockets="6" cores="1" threads="1"/>
Nov 02 12:00:56 user nova-compute[74534]: </cpu>
Nov 02 12:00:56 user nova-compute[74534]:  {{(pid=74534) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Updated inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Updating resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 generation from 0 to 1 during operation: update_inventory {{(pid=74534) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 12:00:56 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:00:57 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Updating resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 generation from 1 to 2 during operation: update_traits {{(pid=74534) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 12:00:57 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:00:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:00:57 user nova-compute[74534]: DEBUG nova.service [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Creating RPC server for service compute {{(pid=74534) start /opt/stack/nova/nova/service.py:182}}
Nov 02 12:00:57 user nova-compute[74534]: DEBUG nova.service [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] Join ServiceGroup membership for this service compute {{(pid=74534) start /opt/stack/nova/nova/service.py:199}}
Nov 02 12:00:57 user nova-compute[74534]: DEBUG nova.servicegroup.drivers.db [None req-a49baa6e-9727-4dc2-b69e-a316eb2f9089 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74534) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 02 12:01:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:01:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:01:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=10388MB free_disk=26.06204605102539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:01:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:02:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:02:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:02:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=10309MB free_disk=26.126388549804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:02:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:02:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:02:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:03:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:03:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:03:49 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:03:49 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:03:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=10294MB free_disk=25.87991714477539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:03:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:03:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:03:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:04:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:04:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:04:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:04:51 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:04:51 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:04:51 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9590MB free_disk=25.907894134521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:04:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:04:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:04:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:57 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:04:57 user nova-compute[74534]: INFO nova.compute.claims [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Claim successful on node user
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.169s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:04:58 user nova-compute[74534]: INFO nova.compute.claims [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Claim successful on node user
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.network.neutron [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:04:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:04:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Creating image(s)
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "/opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "/opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "/opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:04:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:04:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Creating image(s)
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "/opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:04:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:04:59 user nova-compute[74534]: DEBUG nova.policy [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'caf5cde0e75e444da00c7bcda4bcdd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ccb20fcd184ecebd3707d9d93c8817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:00 user nova-compute[74534]: DEBUG nova.policy [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08838f4489be468fa1625807a9136789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e910bd90b24252b3ddb17f71ebfca5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:00 user nova-compute[74534]: DEBUG nova.virt.images [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] 36642543-2106-4841-8acf-2e35b58c4209 was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:05:00 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.part /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.part /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.converted" returned: 0 in 0.730s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.396s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:01 user nova-compute[74534]: INFO oslo.privsep.daemon [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5i_1_x6p/privsep.sock']
Nov 02 12:05:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 2.098s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:01 user sudo[83818]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5i_1_x6p/privsep.sock
Nov 02 12:05:01 user sudo[83818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 12:05:02 user nova-compute[74534]: DEBUG nova.network.neutron [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Successfully created port: b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Successfully created port: f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:02 user sudo[83818]: pam_unix(sudo:session): session closed for user root
Nov 02 12:05:02 user nova-compute[74534]: INFO oslo.privsep.daemon [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Spawned new privsep daemon via rootwrap
Nov 02 12:05:02 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 12:05:02 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 12:05:02 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 02 12:05:02 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83821
Nov 02 12:05:02 user nova-compute[74534]: WARNING oslo_privsep.priv_context [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] privsep daemon already running
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.154s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk 1073741824" returned: 0 in 0.086s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.247s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk 1073741824" returned: 0 in 0.050s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Cannot resize image /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Ensure instance console log exists: /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.157s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Cannot resize image /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Ensure instance console log exists: /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:03 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:03 user nova-compute[74534]: INFO nova.compute.claims [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Claim successful on node user
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:04 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:04 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Creating image(s)
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "/opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "/opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "/opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.policy [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e63b6c90e2784a209a5a7300b985f47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c253a7a30a6841c0a231f30d9da9b66c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk 1073741824" returned: 0 in 0.069s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:05 user nova-compute[74534]: INFO nova.compute.claims [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Claim successful on node user
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Successfully updated port: b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquired lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Successfully updated port: f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.213s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Cannot resize image /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Ensure instance console log exists: /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received event network-changed-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Refreshing instance network info cache due to event network-changed-b5f9e205-ed68-4f2c-a16e-4d4128024804. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] Acquiring lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.109s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:05 user nova-compute[74534]: INFO nova.compute.claims [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Claim successful on node user
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received event network-changed-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Refreshing instance network info cache due to event network-changed-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] Acquiring lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Creating image(s)
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.policy [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4eb3d0118fba4c4eb8edebcb7e68eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f40e1ed522748be85c5bdd3b6405652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:05 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk 1073741824" returned: 0 in 0.048s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Creating image(s)
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "/opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "/opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updating instance_info_cache with network_info: [{"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.policy [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec72fd62d437457ba42756f1da97516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f787c9b1e8154b4da75ac5299c888706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updating instance_info_cache with network_info: [{"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Releasing lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Instance network_info: |[{"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] Acquired lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.neutron [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Refreshing network info cache for port b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Start _get_guest_xml network_info=[{"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Instance network_info: |[{"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] Acquired lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.neutron [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Refreshing network info cache for port f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Start _get_guest_xml network_info=[{"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:04:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-514979507',display_name='tempest-DeleteServersTestJSON-server-514979507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-514979507',id=1,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e910bd90b24252b3ddb17f71ebfca5',ramdisk_id='',reservation_id='r-0aspby1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2109873852',owner_user_name='tempest-DeleteServersTestJSON-2109873852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:04:59Z,user_data=None,user_id='08838f4489be468fa1625807a9136789',uuid=85b625b9-3a28-4916-a773-9797941f35d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Converting VIF {"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f6:1e,bridge_name='br-int',has_traffic_filtering=True,id=b5f9e205-ed68-4f2c-a16e-4d4128024804,network=Network(7e0d2024-e3a3-4c0a-b427-29756c45d9a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f9e205-ed') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.objects.instance [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b625b9-3a28-4916-a773-9797941f35d3 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.291s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-115111698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-115111698',id=2,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-2y6fsbi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:04:59Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=3390f6a1-9306-42a3-af5a-b26e113c0b08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:4f,bridge_name='br-int',has_traffic_filtering=True,id=f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b8eb91-9d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.objects.instance [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'pci_devices' on Instance uuid 3390f6a1-9306-42a3-af5a-b26e113c0b08 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:06 user nova-compute[74534]:   <uuid>85b625b9-3a28-4916-a773-9797941f35d3</uuid>
Nov 02 12:05:06 user nova-compute[74534]:   <name>instance-00000001</name>
Nov 02 12:05:06 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:06 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:06 user nova-compute[74534]:   <metadata>
Nov 02 12:05:06 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:06 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:name>tempest-DeleteServersTestJSON-server-514979507</nova:name>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:06</nova:creationTime>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:06 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:06 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:user uuid="08838f4489be468fa1625807a9136789">tempest-DeleteServersTestJSON-2109873852-project-member</nova:user>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:project uuid="c0e910bd90b24252b3ddb17f71ebfca5">tempest-DeleteServersTestJSON-2109873852</nova:project>
Nov 02 12:05:06 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:port uuid="b5f9e205-ed68-4f2c-a16e-4d4128024804">
Nov 02 12:05:06 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:05:06 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:06 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:06 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:06 user nova-compute[74534]:   </metadata>
Nov 02 12:05:06 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:06 user nova-compute[74534]:     <system>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="serial">85b625b9-3a28-4916-a773-9797941f35d3</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="uuid">85b625b9-3a28-4916-a773-9797941f35d3</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:06 user nova-compute[74534]:     </system>
Nov 02 12:05:06 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:06 user nova-compute[74534]:   <os>
Nov 02 12:05:06 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:06 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:06 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:06 user nova-compute[74534]:   </os>
Nov 02 12:05:06 user nova-compute[74534]:   <features>
Nov 02 12:05:06 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:06 user nova-compute[74534]:     <apic/>
Nov 02 12:05:06 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:06 user nova-compute[74534]:   </features>
Nov 02 12:05:06 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:06 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:06 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:06 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:06 user nova-compute[74534]:   </clock>
Nov 02 12:05:06 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:06 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:06 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:06 user nova-compute[74534]:   </cpu>
Nov 02 12:05:06 user nova-compute[74534]:   <devices>
Nov 02 12:05:06 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:06 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:06 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk"/>
Nov 02 12:05:06 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:06 user nova-compute[74534]:     </disk>
Nov 02 12:05:06 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:06 user nova-compute[74534]:       <mac address="fa:16:3e:91:f6:1e"/>
Nov 02 12:05:06 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:06 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:06 user nova-compute[74534]:       <target dev="tapb5f9e205-ed"/>
Nov 02 12:05:06 user nova-compute[74534]:     </interface>
Nov 02 12:05:06 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:06 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/console.log" append="off"/>
Nov 02 12:05:06 user nova-compute[74534]:     </serial>
Nov 02 12:05:06 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:06 user nova-compute[74534]:     <video>
Nov 02 12:05:06 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:06 user nova-compute[74534]:     </video>
Nov 02 12:05:06 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:06 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:06 user nova-compute[74534]:     </rng>
Nov 02 12:05:06 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:06 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:06 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:06 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:06 user nova-compute[74534]:   </devices>
Nov 02 12:05:06 user nova-compute[74534]: </domain>
Nov 02 12:05:06 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:04:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-514979507',display_name='tempest-DeleteServersTestJSON-server-514979507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-514979507',id=1,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e910bd90b24252b3ddb17f71ebfca5',ramdisk_id='',reservation_id='r-0aspby1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2109873852',owner_user_name='tempest-DeleteServersTestJSON-2109873852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:04:59Z,user_data=None,user_id='08838f4489be468fa1625807a9136789',uuid=85b625b9-3a28-4916-a773-9797941f35d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Converting VIF {"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f6:1e,bridge_name='br-int',has_traffic_filtering=True,id=b5f9e205-ed68-4f2c-a16e-4d4128024804,network=Network(7e0d2024-e3a3-4c0a-b427-29756c45d9a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f9e205-ed') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG os_vif [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f6:1e,bridge_name='br-int',has_traffic_filtering=True,id=b5f9e205-ed68-4f2c-a16e-4d4128024804,network=Network(7e0d2024-e3a3-4c0a-b427-29756c45d9a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f9e205-ed') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:06 user nova-compute[74534]:   <uuid>3390f6a1-9306-42a3-af5a-b26e113c0b08</uuid>
Nov 02 12:05:06 user nova-compute[74534]:   <name>instance-00000002</name>
Nov 02 12:05:06 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:06 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:06 user nova-compute[74534]:   <metadata>
Nov 02 12:05:06 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:06 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-115111698</nova:name>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:06</nova:creationTime>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:06 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:06 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:user uuid="caf5cde0e75e444da00c7bcda4bcdd28">tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member</nova:user>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:project uuid="25ccb20fcd184ecebd3707d9d93c8817">tempest-ServerBootFromVolumeStableRescueTest-1363504210</nova:project>
Nov 02 12:05:06 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:06 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:06 user nova-compute[74534]:         <nova:port uuid="f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c">
Nov 02 12:05:06 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:05:06 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:06 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:06 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:06 user nova-compute[74534]:   </metadata>
Nov 02 12:05:06 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:06 user nova-compute[74534]:     <system>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="serial">3390f6a1-9306-42a3-af5a-b26e113c0b08</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="uuid">3390f6a1-9306-42a3-af5a-b26e113c0b08</entry>
Nov 02 12:05:06 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:06 user nova-compute[74534]:     </system>
Nov 02 12:05:06 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:06 user nova-compute[74534]:   <os>
Nov 02 12:05:06 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:06 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:06 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:06 user nova-compute[74534]:   </os>
Nov 02 12:05:06 user nova-compute[74534]:   <features>
Nov 02 12:05:06 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:06 user nova-compute[74534]:     <apic/>
Nov 02 12:05:06 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:06 user nova-compute[74534]:   </features>
Nov 02 12:05:06 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:06 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:06 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:06 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:06 user nova-compute[74534]:   </clock>
Nov 02 12:05:06 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:06 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:06 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:06 user nova-compute[74534]:   </cpu>
Nov 02 12:05:06 user nova-compute[74534]:   <devices>
Nov 02 12:05:06 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:06 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:06 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk"/>
Nov 02 12:05:06 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:06 user nova-compute[74534]:     </disk>
Nov 02 12:05:06 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:06 user nova-compute[74534]:       <mac address="fa:16:3e:e9:3d:4f"/>
Nov 02 12:05:06 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:06 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:06 user nova-compute[74534]:       <target dev="tapf6b8eb91-9d"/>
Nov 02 12:05:06 user nova-compute[74534]:     </interface>
Nov 02 12:05:06 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:06 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/console.log" append="off"/>
Nov 02 12:05:06 user nova-compute[74534]:     </serial>
Nov 02 12:05:06 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:06 user nova-compute[74534]:     <video>
Nov 02 12:05:06 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:06 user nova-compute[74534]:     </video>
Nov 02 12:05:06 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:06 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:06 user nova-compute[74534]:     </rng>
Nov 02 12:05:06 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:06 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:06 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:06 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:06 user nova-compute[74534]:   </devices>
Nov 02 12:05:06 user nova-compute[74534]: </domain>
Nov 02 12:05:06 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-115111698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-115111698',id=2,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-2y6fsbi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:04:59Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=3390f6a1-9306-42a3-af5a-b26e113c0b08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:4f,bridge_name='br-int',has_traffic_filtering=True,id=f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b8eb91-9d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG os_vif [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:4f,bridge_name='br-int',has_traffic_filtering=True,id=f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b8eb91-9d') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Created schema index Interface.name {{(pid=74534) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Created schema index Port.name {{(pid=74534) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Created schema index Bridge.name {{(pid=74534) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [POLLOUT] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [POLLIN] on fd 32 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] tcp:127.0.0.1:6640: entering BACKOFF {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] schema index <ovs.db.idl.IdlTable object at 0x7fe1982b4e50>.name already exists {{(pid=74534) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] schema index <ovs.db.idl.IdlTable object at 0x7fe1807b3460>.name already exists {{(pid=74534) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] schema index <ovs.db.idl.IdlTable object at 0x7fe1807b1180>.name already exists {{(pid=74534) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.269s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Cannot resize image /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Ensure instance console log exists: /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Successfully created port: 6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk 1073741824" returned: 0 in 0.070s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:07 user nova-compute[74534]: INFO nova.compute.claims [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Claim successful on node user
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '739ea0f8-6688-57b7-9278-9bf8fe0744c6', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '631e6c9a-6f58-5f7f-8bf4-65b08dee487f', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:07 user nova-compute[74534]: INFO oslo.privsep.daemon [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp649hwoqo/privsep.sock']
Nov 02 12:05:07 user sudo[83903]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp649hwoqo/privsep.sock
Nov 02 12:05:07 user sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Cannot resize image /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Ensure instance console log exists: /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.120s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:07 user nova-compute[74534]: INFO nova.compute.claims [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Claim successful on node user
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:07 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:07 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Creating image(s)
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.network.neutron [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updated VIF entry in instance network info cache for port b5f9e205-ed68-4f2c-a16e-4d4128024804. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.network.neutron [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updating instance_info_cache with network_info: [{"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ecb12f31-9582-4c73-b3ba-46ffbdd08ac5 req-0c0c87f3-4c5e-4a53-b95f-1261ff5c6e40 service nova] Releasing lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.network.neutron [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updated VIF entry in instance network info cache for port f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.network.neutron [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updating instance_info_cache with network_info: [{"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2a1c29d3-69d2-480d-b4da-794fae17b4ef req-b68fe396-5549-4347-b529-817c8dcfb804 service nova] Releasing lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.policy [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e552c4c23df4919957749b5a4b1447d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca53e8b45e248c8accd59e5d57e4fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:07 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk 1073741824" returned: 0 in 0.043s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Creating image(s)
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.policy [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cb6a67fcb13459880727c825793db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcb68ce88ae4280ba6feb308b7c53da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Successfully created port: 77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.170s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Cannot resize image /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Ensure instance console log exists: /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk 1073741824" returned: 0 in 0.041s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user sudo[83903]: pam_unix(sudo:session): session closed for user root
Nov 02 12:05:08 user nova-compute[74534]: INFO oslo.privsep.daemon [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Spawned new privsep daemon via rootwrap
Nov 02 12:05:08 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 12:05:08 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 12:05:08 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 02 12:05:08 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83930
Nov 02 12:05:08 user nova-compute[74534]: WARNING oslo_privsep.priv_context [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] privsep daemon already running
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Cannot resize image /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Ensure instance console log exists: /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6b8eb91-9d, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6b8eb91-9d, col_values=(('qos', UUID('3b9ece0e-9a12-4f04-833f-1a9ca7fa6b95')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6b8eb91-9d, col_values=(('external_ids', {'iface-id': 'f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:3d:4f', 'vm-uuid': '3390f6a1-9306-42a3-af5a-b26e113c0b08'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:09 user nova-compute[74534]: INFO os_vif [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3d:4f,bridge_name='br-int',has_traffic_filtering=True,id=f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b8eb91-9d')
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f9e205-ed, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5f9e205-ed, col_values=(('qos', UUID('128263b9-c7b2-4fdd-86e0-330f57a3cb3b')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5f9e205-ed, col_values=(('external_ids', {'iface-id': 'b5f9e205-ed68-4f2c-a16e-4d4128024804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:f6:1e', 'vm-uuid': '85b625b9-3a28-4916-a773-9797941f35d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:09 user nova-compute[74534]: INFO os_vif [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f6:1e,bridge_name='br-int',has_traffic_filtering=True,id=b5f9e205-ed68-4f2c-a16e-4d4128024804,network=Network(7e0d2024-e3a3-4c0a-b427-29756c45d9a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f9e205-ed')
Nov 02 12:05:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No VIF found with MAC fa:16:3e:e9:3d:4f, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] No VIF found with MAC fa:16:3e:91:f6:1e, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Successfully created port: eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Successfully created port: 540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Successfully updated port: 6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquired lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Successfully updated port: 77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquired lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-changed-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Refreshing instance network info cache due to event network-changed-77f86a40-464c-4f30-a11d-abf8b4a7f8d4. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] Acquiring lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received event network-changed-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Refreshing instance network info cache due to event network-changed-6bd2394c-d906-4662-a101-dc05b7f71de0. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] Acquiring lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.neutron [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Successfully created port: e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Releasing lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance network_info: |[{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] Acquired lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Refreshing network info cache for port 77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Start _get_guest_xml network_info=[{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.objects.instance [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'pci_devices' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:11 user nova-compute[74534]:   <uuid>ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</uuid>
Nov 02 12:05:11 user nova-compute[74534]:   <name>instance-00000004</name>
Nov 02 12:05:11 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:11 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:11 user nova-compute[74534]:   <metadata>
Nov 02 12:05:11 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:11 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:11 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeTestJSON-server-884397019</nova:name>
Nov 02 12:05:11 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:11</nova:creationTime>
Nov 02 12:05:11 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:11 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:11 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:11 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:11 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:11 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:11 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:11 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:11 user nova-compute[74534]:         <nova:user uuid="4eb3d0118fba4c4eb8edebcb7e68eb93">tempest-AttachVolumeTestJSON-1871374392-project-member</nova:user>
Nov 02 12:05:11 user nova-compute[74534]:         <nova:project uuid="6f40e1ed522748be85c5bdd3b6405652">tempest-AttachVolumeTestJSON-1871374392</nova:project>
Nov 02 12:05:11 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:11 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:11 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:11 user nova-compute[74534]:         <nova:port uuid="77f86a40-464c-4f30-a11d-abf8b4a7f8d4">
Nov 02 12:05:11 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:05:11 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:11 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:11 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:11 user nova-compute[74534]:   </metadata>
Nov 02 12:05:11 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:11 user nova-compute[74534]:     <system>
Nov 02 12:05:11 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:11 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:11 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:11 user nova-compute[74534]:       <entry name="serial">ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</entry>
Nov 02 12:05:11 user nova-compute[74534]:       <entry name="uuid">ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</entry>
Nov 02 12:05:11 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:11 user nova-compute[74534]:     </system>
Nov 02 12:05:11 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:11 user nova-compute[74534]:   <os>
Nov 02 12:05:11 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:11 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:11 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:11 user nova-compute[74534]:   </os>
Nov 02 12:05:11 user nova-compute[74534]:   <features>
Nov 02 12:05:11 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:11 user nova-compute[74534]:     <apic/>
Nov 02 12:05:11 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:11 user nova-compute[74534]:   </features>
Nov 02 12:05:11 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:11 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:11 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:11 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:11 user nova-compute[74534]:   </clock>
Nov 02 12:05:11 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:11 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:11 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:11 user nova-compute[74534]:   </cpu>
Nov 02 12:05:11 user nova-compute[74534]:   <devices>
Nov 02 12:05:11 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:11 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:11 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk"/>
Nov 02 12:05:11 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:11 user nova-compute[74534]:     </disk>
Nov 02 12:05:11 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:11 user nova-compute[74534]:       <mac address="fa:16:3e:72:88:5c"/>
Nov 02 12:05:11 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:11 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:11 user nova-compute[74534]:       <target dev="tap77f86a40-46"/>
Nov 02 12:05:11 user nova-compute[74534]:     </interface>
Nov 02 12:05:11 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:11 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/console.log" append="off"/>
Nov 02 12:05:11 user nova-compute[74534]:     </serial>
Nov 02 12:05:11 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:11 user nova-compute[74534]:     <video>
Nov 02 12:05:11 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:11 user nova-compute[74534]:     </video>
Nov 02 12:05:11 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:11 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:11 user nova-compute[74534]:     </rng>
Nov 02 12:05:11 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:11 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:11 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:11 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:11 user nova-compute[74534]:   </devices>
Nov 02 12:05:11 user nova-compute[74534]: </domain>
Nov 02 12:05:11 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG os_vif [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c6cbe1e-6215-585b-a8b9-cffff15f9e89', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77f86a40-46, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77f86a40-46, col_values=(('qos', UUID('d23cab29-f9db-4009-84b3-4f846b28cab2')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77f86a40-46, col_values=(('external_ids', {'iface-id': '77f86a40-464c-4f30-a11d-abf8b4a7f8d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:88:5c', 'vm-uuid': 'ed72d4f3-1405-4e45-8c51-68b6fa57a3c1'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:11 user nova-compute[74534]: INFO os_vif [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46')
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Releasing lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance network_info: |[{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] Acquired lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Refreshing network info cache for port 6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Start _get_guest_xml network_info=[{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No VIF found with MAC fa:16:3e:72:88:5c, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:11 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2130605991',display_name='tempest-ServerActionsTestOtherB-server-2130605991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2130605991',id=3,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyXevzzyGgg4+GaKM5XRqX2ueUd/PMUbZw4+E9/82E2Xdqds5ls0nogBKehj5TA3RwtugaQqFt5VCxoMw1V4Q2Y1sw8BfaMErazKbOIIAiJ2DZFBh8oNzVRdHN+0rybZw==',key_name='tempest-keypair-1958950750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c253a7a30a6841c0a231f30d9da9b66c',ramdisk_id='',reservation_id='r-9fi998ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1657074801',owner_user_name='tempest-ServerActionsTestOtherB-1657074801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e63b6c90e2784a209a5a7300b985f47c',uuid=603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converting VIF {"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lazy-loading 'pci_devices' on Instance uuid 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:12 user nova-compute[74534]:   <uuid>603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76</uuid>
Nov 02 12:05:12 user nova-compute[74534]:   <name>instance-00000003</name>
Nov 02 12:05:12 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:12 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:12 user nova-compute[74534]:   <metadata>
Nov 02 12:05:12 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:12 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:12 user nova-compute[74534]:       <nova:name>tempest-ServerActionsTestOtherB-server-2130605991</nova:name>
Nov 02 12:05:12 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:11</nova:creationTime>
Nov 02 12:05:12 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:12 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:12 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:12 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:12 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:12 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:12 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:12 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:12 user nova-compute[74534]:         <nova:user uuid="e63b6c90e2784a209a5a7300b985f47c">tempest-ServerActionsTestOtherB-1657074801-project-member</nova:user>
Nov 02 12:05:12 user nova-compute[74534]:         <nova:project uuid="c253a7a30a6841c0a231f30d9da9b66c">tempest-ServerActionsTestOtherB-1657074801</nova:project>
Nov 02 12:05:12 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:12 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:12 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:12 user nova-compute[74534]:         <nova:port uuid="6bd2394c-d906-4662-a101-dc05b7f71de0">
Nov 02 12:05:12 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 12:05:12 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:12 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:12 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:12 user nova-compute[74534]:   </metadata>
Nov 02 12:05:12 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:12 user nova-compute[74534]:     <system>
Nov 02 12:05:12 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:12 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:12 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:12 user nova-compute[74534]:       <entry name="serial">603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76</entry>
Nov 02 12:05:12 user nova-compute[74534]:       <entry name="uuid">603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76</entry>
Nov 02 12:05:12 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:12 user nova-compute[74534]:     </system>
Nov 02 12:05:12 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:12 user nova-compute[74534]:   <os>
Nov 02 12:05:12 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:12 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:12 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:12 user nova-compute[74534]:   </os>
Nov 02 12:05:12 user nova-compute[74534]:   <features>
Nov 02 12:05:12 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:12 user nova-compute[74534]:     <apic/>
Nov 02 12:05:12 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:12 user nova-compute[74534]:   </features>
Nov 02 12:05:12 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:12 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:12 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:12 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:12 user nova-compute[74534]:   </clock>
Nov 02 12:05:12 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:12 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:12 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:12 user nova-compute[74534]:   </cpu>
Nov 02 12:05:12 user nova-compute[74534]:   <devices>
Nov 02 12:05:12 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:12 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:12 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk"/>
Nov 02 12:05:12 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:12 user nova-compute[74534]:     </disk>
Nov 02 12:05:12 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:12 user nova-compute[74534]:       <mac address="fa:16:3e:b6:67:db"/>
Nov 02 12:05:12 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:12 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:12 user nova-compute[74534]:       <target dev="tap6bd2394c-d9"/>
Nov 02 12:05:12 user nova-compute[74534]:     </interface>
Nov 02 12:05:12 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:12 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/console.log" append="off"/>
Nov 02 12:05:12 user nova-compute[74534]:     </serial>
Nov 02 12:05:12 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:12 user nova-compute[74534]:     <video>
Nov 02 12:05:12 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:12 user nova-compute[74534]:     </video>
Nov 02 12:05:12 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:12 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:12 user nova-compute[74534]:     </rng>
Nov 02 12:05:12 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:12 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:12 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:12 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:12 user nova-compute[74534]:   </devices>
Nov 02 12:05:12 user nova-compute[74534]: </domain>
Nov 02 12:05:12 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2130605991',display_name='tempest-ServerActionsTestOtherB-server-2130605991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2130605991',id=3,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyXevzzyGgg4+GaKM5XRqX2ueUd/PMUbZw4+E9/82E2Xdqds5ls0nogBKehj5TA3RwtugaQqFt5VCxoMw1V4Q2Y1sw8BfaMErazKbOIIAiJ2DZFBh8oNzVRdHN+0rybZw==',key_name='tempest-keypair-1958950750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c253a7a30a6841c0a231f30d9da9b66c',ramdisk_id='',reservation_id='r-9fi998ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1657074801',owner_user_name='tempest-ServerActionsTestOtherB-1657074801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e63b6c90e2784a209a5a7300b985f47c',uuid=603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converting VIF {"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG os_vif [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99385f70-823e-56f0-a064-c9027fce7a5b', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bd2394c-d9, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bd2394c-d9, col_values=(('qos', UUID('e04179e3-ee4b-447f-8592-6a586126a0cd')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bd2394c-d9, col_values=(('external_ids', {'iface-id': '6bd2394c-d906-4662-a101-dc05b7f71de0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:67:db', 'vm-uuid': '603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: INFO os_vif [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9')
Nov 02 12:05:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] No VIF found with MAC fa:16:3e:b6:67:db, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Successfully updated port: eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquired lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Successfully updated port: 540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquired lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-changed-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Refreshing instance network info cache due to event network-changed-540e495f-ada0-44bf-99e7-767cb2a0e193. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] Acquiring lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updated VIF entry in instance network info cache for port 77f86a40-464c-4f30-a11d-abf8b4a7f8d4. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-55573ae2-3a3e-4a99-8009-d6e1957def4e req-76479788-fd93-45cc-a499-db95214ed47a service nova] Releasing lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-changed-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Refreshing instance network info cache due to event network-changed-eeff8901-03cf-47f3-b6ef-27d1abc1479a. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] Acquiring lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Updating instance_info_cache with network_info: [{"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Releasing lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Instance network_info: |[{"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updated VIF entry in instance network info cache for port 6bd2394c-d906-4662-a101-dc05b7f71de0. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] Acquired lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Refreshing network info cache for port 540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Start _get_guest_xml network_info=[{"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fd8b5fc9-39f3-448f-a7f5-0b565342b288 req-0d4aa4fc-9528-4b3a-b668-b9b4777cd51d service nova] Releasing lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1768322974',display_name='tempest-AttachVolumeNegativeTest-server-1768322974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1768322974',id=7,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI61lxQw7l6KCLK+hHm1rsjvRdqi1yqyMfWAgMhmL3U0dK9GxMwirSRPEH0z8E8uN+8VAWKtaheOxo/PMD17m+UUwfyFLn1gLXDTeY1oGnTHV9Wt80xqBMxO/vsD1szmRA==',key_name='tempest-keypair-1969996733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-pqiwp23d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:77:65,bridge_name='br-int',has_traffic_filtering=True,id=540e495f-ada0-44bf-99e7-767cb2a0e193,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e495f-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.objects.instance [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:13 user nova-compute[74534]:   <uuid>2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12</uuid>
Nov 02 12:05:13 user nova-compute[74534]:   <name>instance-00000007</name>
Nov 02 12:05:13 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:13 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:13 user nova-compute[74534]:   <metadata>
Nov 02 12:05:13 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:13 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:13 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1768322974</nova:name>
Nov 02 12:05:13 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:13</nova:creationTime>
Nov 02 12:05:13 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:13 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:13 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:13 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:13 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:13 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:13 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:13 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:13 user nova-compute[74534]:         <nova:user uuid="3cb6a67fcb13459880727c825793db65">tempest-AttachVolumeNegativeTest-322425016-project-member</nova:user>
Nov 02 12:05:13 user nova-compute[74534]:         <nova:project uuid="8fcb68ce88ae4280ba6feb308b7c53da">tempest-AttachVolumeNegativeTest-322425016</nova:project>
Nov 02 12:05:13 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:13 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:13 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:13 user nova-compute[74534]:         <nova:port uuid="540e495f-ada0-44bf-99e7-767cb2a0e193">
Nov 02 12:05:13 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 12:05:13 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:13 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:13 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:13 user nova-compute[74534]:   </metadata>
Nov 02 12:05:13 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:13 user nova-compute[74534]:     <system>
Nov 02 12:05:13 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:13 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:13 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:13 user nova-compute[74534]:       <entry name="serial">2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12</entry>
Nov 02 12:05:13 user nova-compute[74534]:       <entry name="uuid">2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12</entry>
Nov 02 12:05:13 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:13 user nova-compute[74534]:     </system>
Nov 02 12:05:13 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:13 user nova-compute[74534]:   <os>
Nov 02 12:05:13 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:13 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:13 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:13 user nova-compute[74534]:   </os>
Nov 02 12:05:13 user nova-compute[74534]:   <features>
Nov 02 12:05:13 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:13 user nova-compute[74534]:     <apic/>
Nov 02 12:05:13 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:13 user nova-compute[74534]:   </features>
Nov 02 12:05:13 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:13 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:13 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:13 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:13 user nova-compute[74534]:   </clock>
Nov 02 12:05:13 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:13 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:13 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:13 user nova-compute[74534]:   </cpu>
Nov 02 12:05:13 user nova-compute[74534]:   <devices>
Nov 02 12:05:13 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:13 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:13 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk"/>
Nov 02 12:05:13 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:13 user nova-compute[74534]:     </disk>
Nov 02 12:05:13 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:13 user nova-compute[74534]:       <mac address="fa:16:3e:d7:77:65"/>
Nov 02 12:05:13 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:13 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:13 user nova-compute[74534]:       <target dev="tap540e495f-ad"/>
Nov 02 12:05:13 user nova-compute[74534]:     </interface>
Nov 02 12:05:13 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:13 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/console.log" append="off"/>
Nov 02 12:05:13 user nova-compute[74534]:     </serial>
Nov 02 12:05:13 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:13 user nova-compute[74534]:     <video>
Nov 02 12:05:13 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:13 user nova-compute[74534]:     </video>
Nov 02 12:05:13 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:13 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:13 user nova-compute[74534]:     </rng>
Nov 02 12:05:13 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:13 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:13 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:13 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:13 user nova-compute[74534]:   </devices>
Nov 02 12:05:13 user nova-compute[74534]: </domain>
Nov 02 12:05:13 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1768322974',display_name='tempest-AttachVolumeNegativeTest-server-1768322974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1768322974',id=7,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI61lxQw7l6KCLK+hHm1rsjvRdqi1yqyMfWAgMhmL3U0dK9GxMwirSRPEH0z8E8uN+8VAWKtaheOxo/PMD17m+UUwfyFLn1gLXDTeY1oGnTHV9Wt80xqBMxO/vsD1szmRA==',key_name='tempest-keypair-1969996733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-pqiwp23d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:77:65,bridge_name='br-int',has_traffic_filtering=True,id=540e495f-ada0-44bf-99e7-767cb2a0e193,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e495f-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG os_vif [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:77:65,bridge_name='br-int',has_traffic_filtering=True,id=540e495f-ada0-44bf-99e7-767cb2a0e193,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e495f-ad') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e17efacb-640d-5643-8e8a-f3dca078e51b', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap540e495f-ad, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap540e495f-ad, col_values=(('qos', UUID('feaecce1-c367-4fed-94c9-62131a709f50')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap540e495f-ad, col_values=(('external_ids', {'iface-id': '540e495f-ada0-44bf-99e7-767cb2a0e193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:77:65', 'vm-uuid': '2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:13 user nova-compute[74534]: INFO os_vif [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:77:65,bridge_name='br-int',has_traffic_filtering=True,id=540e495f-ada0-44bf-99e7-767cb2a0e193,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e495f-ad')
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Successfully updated port: e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No VIF found with MAC fa:16:3e:d7:77:65, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Releasing lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Instance network_info: |[{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] Acquired lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Refreshing network info cache for port eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Start _get_guest_xml network_info=[{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Updated VIF entry in instance network info cache for port 540e495f-ada0-44bf-99e7-767cb2a0e193. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Updating instance_info_cache with network_info: [{"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75255631-f6ae-43d8-bbbc-8b0354cfd78e req-fac9977a-d1fc-4d59-b0a0-1794239bb3d6 service nova] Releasing lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.neutron [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance network_info: |[{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Start _get_guest_xml network_info=[{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing instance network info cache due to event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updated VIF entry in instance network info cache for port eeff8901-03cf-47f3-b6ef-27d1abc1479a. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c7599f6-d35b-4d6b-8f55-26307d1e4e05 req-48c17e62-1f9e-4e22-8943-a9bbc287540e service nova] Releasing lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Instance spawned successfully.
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-969770704',display_name='tempest-ServerActionsTestOtherA-server-969770704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-969770704',id=5,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-z1xffsfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=d4876f34-2e47-4d28-994d-1c6c0338b850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:5a,bridge_name='br-int',has_traffic_filtering=True,id=eeff8901-03cf-47f3-b6ef-27d1abc1479a,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff8901-03') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.objects.instance [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'pci_devices' on Instance uuid d4876f34-2e47-4d28-994d-1c6c0338b850 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-480445214',display_name='tempest-ServerStableDeviceRescueTest-server-480445214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-480445214',id=6,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdGCJP5nBWInjL/LmHQ0hFRZI4+zAHfsMY/eQ8JRXS8qeH39DzGK8bEZMtTDdEaZ8ykLyjLAanmn0+y2XCypb1IU5QvNEkiyzrDTZJsvCN9KG+79zach52DWPhIgS2JIg==',key_name='tempest-keypair-1756371081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ca53e8b45e248c8accd59e5d57e4fbc',ramdisk_id='',reservation_id='r-1sn0qowx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1725617346',owner_user_name='tempest-ServerStableDeviceRescueTest-1725617346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e552c4c23df4919957749b5a4b1447d',uuid=c7d59af9-1ab5-43b4-84af-3a27cd182e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converting VIF {"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.objects.instance [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'pci_devices' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Instance spawned successfully.
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.network.neutron [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updated VIF entry in instance network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.network.neutron [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:16 user nova-compute[74534]:   <uuid>d4876f34-2e47-4d28-994d-1c6c0338b850</uuid>
Nov 02 12:05:16 user nova-compute[74534]:   <name>instance-00000005</name>
Nov 02 12:05:16 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:16 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:16 user nova-compute[74534]:   <metadata>
Nov 02 12:05:16 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:16 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:name>tempest-ServerActionsTestOtherA-server-969770704</nova:name>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:15</nova:creationTime>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:16 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:16 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:user uuid="ec72fd62d437457ba42756f1da97516c">tempest-ServerActionsTestOtherA-500741581-project-member</nova:user>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:project uuid="f787c9b1e8154b4da75ac5299c888706">tempest-ServerActionsTestOtherA-500741581</nova:project>
Nov 02 12:05:16 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:port uuid="eeff8901-03cf-47f3-b6ef-27d1abc1479a">
Nov 02 12:05:16 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 12:05:16 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:16 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:16 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:16 user nova-compute[74534]:   </metadata>
Nov 02 12:05:16 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:16 user nova-compute[74534]:     <system>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="serial">d4876f34-2e47-4d28-994d-1c6c0338b850</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="uuid">d4876f34-2e47-4d28-994d-1c6c0338b850</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:16 user nova-compute[74534]:     </system>
Nov 02 12:05:16 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:16 user nova-compute[74534]:   <os>
Nov 02 12:05:16 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:16 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:16 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:16 user nova-compute[74534]:   </os>
Nov 02 12:05:16 user nova-compute[74534]:   <features>
Nov 02 12:05:16 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:16 user nova-compute[74534]:     <apic/>
Nov 02 12:05:16 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:16 user nova-compute[74534]:   </features>
Nov 02 12:05:16 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:16 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:16 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:16 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:16 user nova-compute[74534]:   </clock>
Nov 02 12:05:16 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:16 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:16 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:16 user nova-compute[74534]:   </cpu>
Nov 02 12:05:16 user nova-compute[74534]:   <devices>
Nov 02 12:05:16 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:16 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:16 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk"/>
Nov 02 12:05:16 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:16 user nova-compute[74534]:     </disk>
Nov 02 12:05:16 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:16 user nova-compute[74534]:       <mac address="fa:16:3e:9e:3d:5a"/>
Nov 02 12:05:16 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:16 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:16 user nova-compute[74534]:       <target dev="tapeeff8901-03"/>
Nov 02 12:05:16 user nova-compute[74534]:     </interface>
Nov 02 12:05:16 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:16 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/console.log" append="off"/>
Nov 02 12:05:16 user nova-compute[74534]:     </serial>
Nov 02 12:05:16 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:16 user nova-compute[74534]:     <video>
Nov 02 12:05:16 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:16 user nova-compute[74534]:     </video>
Nov 02 12:05:16 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:16 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:16 user nova-compute[74534]:     </rng>
Nov 02 12:05:16 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:16 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:16 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:16 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:16 user nova-compute[74534]:   </devices>
Nov 02 12:05:16 user nova-compute[74534]: </domain>
Nov 02 12:05:16 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-969770704',display_name='tempest-ServerActionsTestOtherA-server-969770704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-969770704',id=5,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-z1xffsfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=d4876f34-2e47-4d28-994d-1c6c0338b850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:5a,bridge_name='br-int',has_traffic_filtering=True,id=eeff8901-03cf-47f3-b6ef-27d1abc1479a,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff8901-03') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG os_vif [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:5a,bridge_name='br-int',has_traffic_filtering=True,id=eeff8901-03cf-47f3-b6ef-27d1abc1479a,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff8901-03') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:16 user nova-compute[74534]:   <uuid>c7d59af9-1ab5-43b4-84af-3a27cd182e29</uuid>
Nov 02 12:05:16 user nova-compute[74534]:   <name>instance-00000006</name>
Nov 02 12:05:16 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:16 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:16 user nova-compute[74534]:   <metadata>
Nov 02 12:05:16 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:16 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-480445214</nova:name>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:15</nova:creationTime>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:16 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:16 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:user uuid="4e552c4c23df4919957749b5a4b1447d">tempest-ServerStableDeviceRescueTest-1725617346-project-member</nova:user>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:project uuid="8ca53e8b45e248c8accd59e5d57e4fbc">tempest-ServerStableDeviceRescueTest-1725617346</nova:project>
Nov 02 12:05:16 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:16 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:16 user nova-compute[74534]:         <nova:port uuid="e87382cc-9797-48c4-b9b7-eaf7c1d85ea2">
Nov 02 12:05:16 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:05:16 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:16 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:16 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:16 user nova-compute[74534]:   </metadata>
Nov 02 12:05:16 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:16 user nova-compute[74534]:     <system>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="serial">c7d59af9-1ab5-43b4-84af-3a27cd182e29</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="uuid">c7d59af9-1ab5-43b4-84af-3a27cd182e29</entry>
Nov 02 12:05:16 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:16 user nova-compute[74534]:     </system>
Nov 02 12:05:16 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:16 user nova-compute[74534]:   <os>
Nov 02 12:05:16 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:16 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:16 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:16 user nova-compute[74534]:   </os>
Nov 02 12:05:16 user nova-compute[74534]:   <features>
Nov 02 12:05:16 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:16 user nova-compute[74534]:     <apic/>
Nov 02 12:05:16 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:16 user nova-compute[74534]:   </features>
Nov 02 12:05:16 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:16 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:16 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:16 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:16 user nova-compute[74534]:   </clock>
Nov 02 12:05:16 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:16 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:16 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:16 user nova-compute[74534]:   </cpu>
Nov 02 12:05:16 user nova-compute[74534]:   <devices>
Nov 02 12:05:16 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:16 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:16 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk"/>
Nov 02 12:05:16 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:16 user nova-compute[74534]:     </disk>
Nov 02 12:05:16 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:16 user nova-compute[74534]:       <mac address="fa:16:3e:eb:98:c7"/>
Nov 02 12:05:16 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:16 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:16 user nova-compute[74534]:       <target dev="tape87382cc-97"/>
Nov 02 12:05:16 user nova-compute[74534]:     </interface>
Nov 02 12:05:16 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:16 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/console.log" append="off"/>
Nov 02 12:05:16 user nova-compute[74534]:     </serial>
Nov 02 12:05:16 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:16 user nova-compute[74534]:     <video>
Nov 02 12:05:16 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:16 user nova-compute[74534]:     </video>
Nov 02 12:05:16 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:16 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:16 user nova-compute[74534]:     </rng>
Nov 02 12:05:16 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:16 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:16 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:16 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:16 user nova-compute[74534]:   </devices>
Nov 02 12:05:16 user nova-compute[74534]: </domain>
Nov 02 12:05:16 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-480445214',display_name='tempest-ServerStableDeviceRescueTest-server-480445214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-480445214',id=6,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdGCJP5nBWInjL/LmHQ0hFRZI4+zAHfsMY/eQ8JRXS8qeH39DzGK8bEZMtTDdEaZ8ykLyjLAanmn0+y2XCypb1IU5QvNEkiyzrDTZJsvCN9KG+79zach52DWPhIgS2JIg==',key_name='tempest-keypair-1756371081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ca53e8b45e248c8accd59e5d57e4fbc',ramdisk_id='',reservation_id='r-1sn0qowx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1725617346',owner_user_name='tempest-ServerStableDeviceRescueTest-1725617346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e552c4c23df4919957749b5a4b1447d',uuid=c7d59af9-1ab5-43b4-84af-3a27cd182e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converting VIF {"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG os_vif [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9d744499-bb66-4da1-9b83-f82fbea29aba req-ef66c685-5b8e-477a-a4b9-0a1f37ba1f89 service nova] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09fa1429-68e1-5811-8328-56a5dfda28d0', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26e3cfc3-3a42-52b2-9016-fd946b53f4c2', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeff8901-03, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeff8901-03, col_values=(('qos', UUID('f279ae84-00ca-4f2c-a28b-f01926977e5f')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeff8901-03, col_values=(('external_ids', {'iface-id': 'eeff8901-03cf-47f3-b6ef-27d1abc1479a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:3d:5a', 'vm-uuid': 'd4876f34-2e47-4d28-994d-1c6c0338b850'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: INFO os_vif [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:5a,bridge_name='br-int',has_traffic_filtering=True,id=eeff8901-03cf-47f3-b6ef-27d1abc1479a,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff8901-03')
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape87382cc-97, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape87382cc-97, col_values=(('qos', UUID('0fa73ee0-893d-4587-9a0a-47b371314af1')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape87382cc-97, col_values=(('external_ids', {'iface-id': 'e87382cc-9797-48c4-b9b7-eaf7c1d85ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:98:c7', 'vm-uuid': 'c7d59af9-1ab5-43b4-84af-3a27cd182e29'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: INFO nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Took 17.35 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:16 user nova-compute[74534]: INFO nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Took 17.67 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:16 user nova-compute[74534]: INFO os_vif [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97')
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No VIF found with MAC fa:16:3e:9e:3d:5a, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:16 user nova-compute[74534]: INFO nova.compute.manager [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Took 18.46 seconds to build instance.
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No VIF found with MAC fa:16:3e:eb:98:c7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b30a2c2b-0587-49d0-92a4-c3a4a2c4384d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.813s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:16 user nova-compute[74534]: INFO nova.compute.manager [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Took 19.11 seconds to build instance.
Nov 02 12:05:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-659a4299-0286-4996-a48a-3776a8128077 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.356s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-24641a94-5673-4cfc-9c8a-228e270eec77 req-4fde4fe1-2649-4624-99c7-6c6d9c2bbf62 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-24641a94-5673-4cfc-9c8a-228e270eec77 req-4fde4fe1-2649-4624-99c7-6c6d9c2bbf62 service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-24641a94-5673-4cfc-9c8a-228e270eec77 req-4fde4fe1-2649-4624-99c7-6c6d9c2bbf62 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-24641a94-5673-4cfc-9c8a-228e270eec77 req-4fde4fe1-2649-4624-99c7-6c6d9c2bbf62 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-24641a94-5673-4cfc-9c8a-228e270eec77 req-4fde4fe1-2649-4624-99c7-6c6d9c2bbf62 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:22 user nova-compute[74534]: WARNING nova.compute.manager [req-24641a94-5673-4cfc-9c8a-228e270eec77 req-4fde4fe1-2649-4624-99c7-6c6d9c2bbf62 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state building and task_state spawning.
Nov 02 12:05:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:23 user nova-compute[74534]: INFO nova.compute.claims [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Claim successful on node user
Nov 02 12:05:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance spawned successfully.
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:23 user nova-compute[74534]: INFO nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Took 19.22 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance spawned successfully.
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:24 user nova-compute[74534]: INFO nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Took 18.16 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:24 user nova-compute[74534]: INFO nova.compute.manager [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Took 20.24 seconds to build instance.
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b45a193-fdc7-4e00-89ab-84ae9dbe09fc tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.380s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:24 user nova-compute[74534]: INFO nova.compute.manager [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Took 19.15 seconds to build instance.
Nov 02 12:05:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83fc4530-6fae-4319-9148-8ee28d3cc394 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.341s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.660s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:24 user nova-compute[74534]: WARNING nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state active and task_state None.
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] No waiting events found dispatching network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:24 user nova-compute[74534]: WARNING nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received unexpected event network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a for instance with vm_state building and task_state spawning.
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] No waiting events found dispatching network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:24 user nova-compute[74534]: WARNING nova.compute.manager [req-b32543ed-215c-4729-9378-4e3570c184c2 req-f12bf292-6edb-470f-94a9-ff0d194299d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received unexpected event network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a for instance with vm_state building and task_state spawning.
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:24 user nova-compute[74534]: DEBUG nova.policy [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b846780942574a2e95e439402599b0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6797852b38e8457e950bcf7674f2afb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:25 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Creating image(s)
Nov 02 12:05:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "/opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "/opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "/opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "2ee2f12b5291836db47ea16f68ebc09b99c19241" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "2ee2f12b5291836db47ea16f68ebc09b99c19241" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:25 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance spawned successfully.
Nov 02 12:05:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Instance spawned successfully.
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Instance spawned successfully.
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.part --force-share --output=json" returned: 0 in 0.265s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.images [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] 832e42e5-b2b1-445b-a424-c003fb85d67e was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.part /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:26 user nova-compute[74534]: INFO nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Took 18.62 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:26 user nova-compute[74534]: INFO nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Took 18.19 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:26 user nova-compute[74534]: INFO nova.compute.manager [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Took 19.91 seconds to build instance.
Nov 02 12:05:26 user nova-compute[74534]: INFO nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Took 20.45 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:26 user nova-compute[74534]: INFO nova.compute.manager [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Took 19.57 seconds to build instance.
Nov 02 12:05:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-59b62381-598d-4d91-9cf9-7e8628a320a8 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.290s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.part /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.converted" returned: 0 in 0.693s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0153c5ad-7492-4f7a-b756-6a1885c4052e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.874s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:27 user nova-compute[74534]: INFO nova.compute.manager [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Took 21.73 seconds to build instance.
Nov 02 12:05:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e0a9039-1e71-43b6-b6b0-417c2b072ab8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.915s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Successfully created port: e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241.converted --force-share --output=json" returned: 0 in 0.518s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "2ee2f12b5291836db47ea16f68ebc09b99c19241" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.254s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241 --force-share --output=json" returned: 0 in 0.413s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "2ee2f12b5291836db47ea16f68ebc09b99c19241" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "2ee2f12b5291836db47ea16f68ebc09b99c19241" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.014s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241 --force-share --output=json" returned: 0 in 0.443s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241,backing_fmt=raw /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241,backing_fmt=raw /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk 1073741824" returned: 0 in 0.089s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "2ee2f12b5291836db47ea16f68ebc09b99c19241" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.552s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Successfully updated port: e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquired lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241 --force-share --output=json" returned: 0 in 0.523s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-changed-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Refreshing instance network info cache due to event network-changed-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] Acquiring lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json" returned: 0 in 0.449s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Cannot resize image /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Ensure instance console log exists: /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Updating instance_info_cache with network_info: [{"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Releasing lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Instance network_info: |[{"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] Acquired lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.network.neutron [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Refreshing network info cache for port e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Start _get_guest_xml network_info=[{"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:05:13Z,direct_url=<?>,disk_format='qcow2',id=832e42e5-b2b1-445b-a424-c003fb85d67e,min_disk=0,min_ram=0,name='',owner='de83ca93d06b423d82e8f54a3477a684',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:05:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'scsi', 'image_id': '832e42e5-b2b1-445b-a424-c003fb85d67e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:30 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:30 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:05:13Z,direct_url=<?>,disk_format='qcow2',id=832e42e5-b2b1-445b-a424-c003fb85d67e,min_disk=0,min_ram=0,name='',owner='de83ca93d06b423d82e8f54a3477a684',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:05:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-463582782',display_name='tempest-AttachSCSIVolumeTestJSON-server-463582782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-463582782',id=8,image_ref='832e42e5-b2b1-445b-a424-c003fb85d67e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG34ICnMQhvHFWKbFaeQuJFS8dBDov9Pb6iIeMYvcm53o4a6/a+8FrKgrJVEhUwD5ZBcyAY28Q6J8HEuxXsXrNfeh94lYUZUskYXoyuoezD+EtPKLhw20T5nq6ldS90ZsA==',key_name='tempest-keypair-1313123273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6797852b38e8457e950bcf7674f2afb3',ramdisk_id='',reservation_id='r-9ndy5jyb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='832e42e5-b2b1-445b-a424-c003fb85d67e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-991220014',owner_user_name='tempest-AttachSCSIVolumeTestJSON-991220014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b846780942574a2e95e439402599b0b7',uuid=44fb7ed3-c943-42b2-8254-00aebe23d744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Converting VIF {"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3c:b9,bridge_name='br-int',has_traffic_filtering=True,id=e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3,network=Network(cfc2bf4b-8457-446a-8a46-b9f271884abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01ba90f-3c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lazy-loading 'pci_devices' on Instance uuid 44fb7ed3-c943-42b2-8254-00aebe23d744 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:30 user nova-compute[74534]:   <uuid>44fb7ed3-c943-42b2-8254-00aebe23d744</uuid>
Nov 02 12:05:30 user nova-compute[74534]:   <name>instance-00000008</name>
Nov 02 12:05:30 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:30 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:30 user nova-compute[74534]:   <metadata>
Nov 02 12:05:30 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:30 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:30 user nova-compute[74534]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-463582782</nova:name>
Nov 02 12:05:30 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:30</nova:creationTime>
Nov 02 12:05:30 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:30 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:30 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:30 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:30 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:30 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:30 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:30 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:30 user nova-compute[74534]:         <nova:user uuid="b846780942574a2e95e439402599b0b7">tempest-AttachSCSIVolumeTestJSON-991220014-project-member</nova:user>
Nov 02 12:05:30 user nova-compute[74534]:         <nova:project uuid="6797852b38e8457e950bcf7674f2afb3">tempest-AttachSCSIVolumeTestJSON-991220014</nova:project>
Nov 02 12:05:30 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:30 user nova-compute[74534]:       <nova:root type="image" uuid="832e42e5-b2b1-445b-a424-c003fb85d67e"/>
Nov 02 12:05:30 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:30 user nova-compute[74534]:         <nova:port uuid="e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3">
Nov 02 12:05:30 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:05:30 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:30 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:30 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:30 user nova-compute[74534]:   </metadata>
Nov 02 12:05:30 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:30 user nova-compute[74534]:     <system>
Nov 02 12:05:30 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:30 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:30 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:30 user nova-compute[74534]:       <entry name="serial">44fb7ed3-c943-42b2-8254-00aebe23d744</entry>
Nov 02 12:05:30 user nova-compute[74534]:       <entry name="uuid">44fb7ed3-c943-42b2-8254-00aebe23d744</entry>
Nov 02 12:05:30 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:30 user nova-compute[74534]:     </system>
Nov 02 12:05:30 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:30 user nova-compute[74534]:   <os>
Nov 02 12:05:30 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:30 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:30 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:30 user nova-compute[74534]:   </os>
Nov 02 12:05:30 user nova-compute[74534]:   <features>
Nov 02 12:05:30 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:30 user nova-compute[74534]:     <apic/>
Nov 02 12:05:30 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:30 user nova-compute[74534]:   </features>
Nov 02 12:05:30 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:30 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:30 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:30 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:30 user nova-compute[74534]:   </clock>
Nov 02 12:05:30 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:30 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:30 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:30 user nova-compute[74534]:   </cpu>
Nov 02 12:05:30 user nova-compute[74534]:   <devices>
Nov 02 12:05:30 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:30 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:30 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk"/>
Nov 02 12:05:30 user nova-compute[74534]:       <target dev="sda" bus="scsi"/>
Nov 02 12:05:30 user nova-compute[74534]:       <address type="drive" controller="0" unit="0"/>
Nov 02 12:05:30 user nova-compute[74534]:     </disk>
Nov 02 12:05:30 user nova-compute[74534]:     <disk type="file" device="cdrom">
Nov 02 12:05:30 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 12:05:30 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk.config"/>
Nov 02 12:05:30 user nova-compute[74534]:       <target dev="sdb" bus="scsi"/>
Nov 02 12:05:30 user nova-compute[74534]:       <address type="drive" controller="0" unit="1"/>
Nov 02 12:05:30 user nova-compute[74534]:     </disk>
Nov 02 12:05:30 user nova-compute[74534]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 02 12:05:30 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:30 user nova-compute[74534]:       <mac address="fa:16:3e:a8:3c:b9"/>
Nov 02 12:05:30 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:30 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:30 user nova-compute[74534]:       <target dev="tape01ba90f-3c"/>
Nov 02 12:05:30 user nova-compute[74534]:     </interface>
Nov 02 12:05:30 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:30 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/console.log" append="off"/>
Nov 02 12:05:30 user nova-compute[74534]:     </serial>
Nov 02 12:05:30 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:30 user nova-compute[74534]:     <video>
Nov 02 12:05:30 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:30 user nova-compute[74534]:     </video>
Nov 02 12:05:30 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:30 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:30 user nova-compute[74534]:     </rng>
Nov 02 12:05:30 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:30 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:30 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:30 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:30 user nova-compute[74534]:   </devices>
Nov 02 12:05:30 user nova-compute[74534]: </domain>
Nov 02 12:05:30 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-463582782',display_name='tempest-AttachSCSIVolumeTestJSON-server-463582782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-463582782',id=8,image_ref='832e42e5-b2b1-445b-a424-c003fb85d67e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG34ICnMQhvHFWKbFaeQuJFS8dBDov9Pb6iIeMYvcm53o4a6/a+8FrKgrJVEhUwD5ZBcyAY28Q6J8HEuxXsXrNfeh94lYUZUskYXoyuoezD+EtPKLhw20T5nq6ldS90ZsA==',key_name='tempest-keypair-1313123273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6797852b38e8457e950bcf7674f2afb3',ramdisk_id='',reservation_id='r-9ndy5jyb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='832e42e5-b2b1-445b-a424-c003fb85d67e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-991220014',owner_user_name='tempest-AttachSCSIVolumeTestJSON-991220014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b846780942574a2e95e439402599b0b7',uuid=44fb7ed3-c943-42b2-8254-00aebe23d744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Converting VIF {"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3c:b9,bridge_name='br-int',has_traffic_filtering=True,id=e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3,network=Network(cfc2bf4b-8457-446a-8a46-b9f271884abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01ba90f-3c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG os_vif [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3c:b9,bridge_name='br-int',has_traffic_filtering=True,id=e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3,network=Network(cfc2bf4b-8457-446a-8a46-b9f271884abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01ba90f-3c') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68c93f1a-c79c-5eef-b431-9977b5f7c41f', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape01ba90f-3c, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape01ba90f-3c, col_values=(('qos', UUID('2d99560c-577f-4529-948a-0bc89de9888a')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape01ba90f-3c, col_values=(('external_ids', {'iface-id': 'e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:3c:b9', 'vm-uuid': '44fb7ed3-c943-42b2-8254-00aebe23d744'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:30 user nova-compute[74534]: INFO os_vif [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3c:b9,bridge_name='br-int',has_traffic_filtering=True,id=e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3,network=Network(cfc2bf4b-8457-446a-8a46-b9f271884abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01ba90f-3c')
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] No BDM found with device name sda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] No VIF found with MAC fa:16:3e:a8:3c:b9, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Using config drive
Nov 02 12:05:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Updated VIF entry in instance network info cache for port e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Updating instance_info_cache with network_info: [{"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-686e4b60-9865-4c48-ae4e-b16d198772f3 req-ddb85f1e-c882-440e-aeba-1ade7d2e4483 service nova] Releasing lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Creating config drive at /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk.config
Nov 02 12:05:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2rwypv7i {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2rwypv7i" returned: 0 in 0.078s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:32 user nova-compute[74534]: INFO nova.compute.claims [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Claim successful on node user
Nov 02 12:05:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:32 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:32 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.967s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-fa2e4b21-0e15-42e0-9470-dd39b1db9b26 req-3dc2733e-260f-445b-bd89-e2759d3ebbd3 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received event network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa2e4b21-0e15-42e0-9470-dd39b1db9b26 req-3dc2733e-260f-445b-bd89-e2759d3ebbd3 service nova] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa2e4b21-0e15-42e0-9470-dd39b1db9b26 req-3dc2733e-260f-445b-bd89-e2759d3ebbd3 service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa2e4b21-0e15-42e0-9470-dd39b1db9b26 req-3dc2733e-260f-445b-bd89-e2759d3ebbd3 service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-fa2e4b21-0e15-42e0-9470-dd39b1db9b26 req-3dc2733e-260f-445b-bd89-e2759d3ebbd3 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] No waiting events found dispatching network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:33 user nova-compute[74534]: WARNING nova.compute.manager [req-fa2e4b21-0e15-42e0-9470-dd39b1db9b26 req-3dc2733e-260f-445b-bd89-e2759d3ebbd3 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received unexpected event network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 for instance with vm_state active and task_state None.
Nov 02 12:05:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.policy [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90050c453aad4f63b4a7615a0ff0f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c15ccf99034cb9bdc6ca3e19c1ac29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Creating image(s)
Nov 02 12:05:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.344s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.306s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk 1073741824" returned: 0 in 0.161s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.479s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.259s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.421s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Cannot resize image /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Ensure instance console log exists: /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-6aa137eb-60dc-44b4-8a6a-141bf73f5573 req-d6420081-2800-40fa-a9a9-914b884c4fed service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received event network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6aa137eb-60dc-44b4-8a6a-141bf73f5573 req-d6420081-2800-40fa-a9a9-914b884c4fed service nova] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6aa137eb-60dc-44b4-8a6a-141bf73f5573 req-d6420081-2800-40fa-a9a9-914b884c4fed service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6aa137eb-60dc-44b4-8a6a-141bf73f5573 req-d6420081-2800-40fa-a9a9-914b884c4fed service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-6aa137eb-60dc-44b4-8a6a-141bf73f5573 req-d6420081-2800-40fa-a9a9-914b884c4fed service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] No waiting events found dispatching network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:35 user nova-compute[74534]: WARNING nova.compute.manager [req-6aa137eb-60dc-44b4-8a6a-141bf73f5573 req-d6420081-2800-40fa-a9a9-914b884c4fed service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received unexpected event network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 for instance with vm_state active and task_state None.
Nov 02 12:05:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Successfully created port: 8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:36 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Successfully updated port: 8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquired lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:36 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-changed-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Refreshing instance network info cache due to event network-changed-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] Acquiring lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Releasing lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Instance network_info: |[{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] Acquired lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.network.neutron [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Refreshing network info cache for port 8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Start _get_guest_xml network_info=[{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:37 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:37 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:37 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converting VIF {"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:a9:8a,bridge_name='br-int',has_traffic_filtering=True,id=8e801a89-2f1c-41ef-85c2-67e6ed38ce9c,network=Network(59e93dad-1d76-40aa-9484-457eccf21c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e801a89-2f') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'pci_devices' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:38 user nova-compute[74534]:   <uuid>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</uuid>
Nov 02 12:05:38 user nova-compute[74534]:   <name>instance-00000009</name>
Nov 02 12:05:38 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:38 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:38 user nova-compute[74534]:   <metadata>
Nov 02 12:05:38 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:38 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:38 user nova-compute[74534]:       <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:05:38 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:37</nova:creationTime>
Nov 02 12:05:38 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:38 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:38 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:38 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:38 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:38 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:38 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:38 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:38 user nova-compute[74534]:         <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:05:38 user nova-compute[74534]:         <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:05:38 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:38 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:38 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:38 user nova-compute[74534]:         <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:05:38 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:05:38 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:38 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:38 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:38 user nova-compute[74534]:   </metadata>
Nov 02 12:05:38 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:38 user nova-compute[74534]:     <system>
Nov 02 12:05:38 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:38 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:38 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:38 user nova-compute[74534]:       <entry name="serial">33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:05:38 user nova-compute[74534]:       <entry name="uuid">33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:05:38 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:38 user nova-compute[74534]:     </system>
Nov 02 12:05:38 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:38 user nova-compute[74534]:   <os>
Nov 02 12:05:38 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:38 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:38 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:38 user nova-compute[74534]:   </os>
Nov 02 12:05:38 user nova-compute[74534]:   <features>
Nov 02 12:05:38 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:38 user nova-compute[74534]:     <apic/>
Nov 02 12:05:38 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:38 user nova-compute[74534]:   </features>
Nov 02 12:05:38 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:38 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:38 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:38 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:38 user nova-compute[74534]:   </clock>
Nov 02 12:05:38 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:38 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:38 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:38 user nova-compute[74534]:   </cpu>
Nov 02 12:05:38 user nova-compute[74534]:   <devices>
Nov 02 12:05:38 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:38 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:38 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk"/>
Nov 02 12:05:38 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:38 user nova-compute[74534]:     </disk>
Nov 02 12:05:38 user nova-compute[74534]:     <disk type="file" device="cdrom">
Nov 02 12:05:38 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 12:05:38 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config"/>
Nov 02 12:05:38 user nova-compute[74534]:       <target dev="hda" bus="ide"/>
Nov 02 12:05:38 user nova-compute[74534]:     </disk>
Nov 02 12:05:38 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:38 user nova-compute[74534]:       <mac address="fa:16:3e:31:a9:8a"/>
Nov 02 12:05:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:38 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:38 user nova-compute[74534]:       <target dev="tap8e801a89-2f"/>
Nov 02 12:05:38 user nova-compute[74534]:     </interface>
Nov 02 12:05:38 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:38 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log" append="off"/>
Nov 02 12:05:38 user nova-compute[74534]:     </serial>
Nov 02 12:05:38 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:38 user nova-compute[74534]:     <video>
Nov 02 12:05:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:38 user nova-compute[74534]:     </video>
Nov 02 12:05:38 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:38 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:38 user nova-compute[74534]:     </rng>
Nov 02 12:05:38 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:38 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:38 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:38 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:38 user nova-compute[74534]:   </devices>
Nov 02 12:05:38 user nova-compute[74534]: </domain>
Nov 02 12:05:38 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converting VIF {"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:a9:8a,bridge_name='br-int',has_traffic_filtering=True,id=8e801a89-2f1c-41ef-85c2-67e6ed38ce9c,network=Network(59e93dad-1d76-40aa-9484-457eccf21c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e801a89-2f') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG os_vif [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a9:8a,bridge_name='br-int',has_traffic_filtering=True,id=8e801a89-2f1c-41ef-85c2-67e6ed38ce9c,network=Network(59e93dad-1d76-40aa-9484-457eccf21c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e801a89-2f') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2250093c-62b5-5765-a48c-c6666fea6f31', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e801a89-2f, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e801a89-2f, col_values=(('qos', UUID('3de2e357-6765-48ff-88a7-a9496d8abbed')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e801a89-2f, col_values=(('external_ids', {'iface-id': '8e801a89-2f1c-41ef-85c2-67e6ed38ce9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:a9:8a', 'vm-uuid': '33b75f56-25f3-42b9-a699-5cf4e3bf4f53'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Instance spawned successfully.
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:38 user nova-compute[74534]: INFO os_vif [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a9:8a,bridge_name='br-int',has_traffic_filtering=True,id=8e801a89-2f1c-41ef-85c2-67e6ed38ce9c,network=Network(59e93dad-1d76-40aa-9484-457eccf21c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e801a89-2f')
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:38 user nova-compute[74534]: INFO nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Took 13.04 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No BDM found with device name hda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No VIF found with MAC fa:16:3e:31:a9:8a, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Using config drive
Nov 02 12:05:38 user nova-compute[74534]: INFO nova.compute.manager [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Took 17.68 seconds to build instance.
Nov 02 12:05:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e72321fa-8fcd-4671-b635-2e9d378f5e7b tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.853s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Creating config drive at /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config
Nov 02 12:05:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2lxgfd1i {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.network.neutron [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updated VIF entry in instance network info cache for port 8e801a89-2f1c-41ef-85c2-67e6ed38ce9c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG nova.network.neutron [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2lxgfd1i" returned: 0 in 0.059s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fe185f82-b4f3-49c1-b2ed-0ac4a258a543 req-aa709826-7866-4abc-8ac7-57c0d712a15e service nova] Releasing lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "60fef407-d916-4310-b722-465edfac927b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "60fef407-d916-4310-b722-465edfac927b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:05:40 user nova-compute[74534]: INFO nova.compute.claims [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Claim successful on node user
Nov 02 12:05:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-107b4fb1-7e74-4b9b-b4b5-c0170d781051 req-e7556317-4f01-4b17-a537-4a4859658e18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received event network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-107b4fb1-7e74-4b9b-b4b5-c0170d781051 req-e7556317-4f01-4b17-a537-4a4859658e18 service nova] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-107b4fb1-7e74-4b9b-b4b5-c0170d781051 req-e7556317-4f01-4b17-a537-4a4859658e18 service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-107b4fb1-7e74-4b9b-b4b5-c0170d781051 req-e7556317-4f01-4b17-a537-4a4859658e18 service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-107b4fb1-7e74-4b9b-b4b5-c0170d781051 req-e7556317-4f01-4b17-a537-4a4859658e18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] No waiting events found dispatching network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:40 user nova-compute[74534]: WARNING nova.compute.manager [req-107b4fb1-7e74-4b9b-b4b5-c0170d781051 req-e7556317-4f01-4b17-a537-4a4859658e18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received unexpected event network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 for instance with vm_state active and task_state None.
Nov 02 12:05:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-3fcf6001-b52b-451f-8638-83543d41fb68 req-869493c4-87a9-4fc1-bc32-6b3cf946839c service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received event network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3fcf6001-b52b-451f-8638-83543d41fb68 req-869493c4-87a9-4fc1-bc32-6b3cf946839c service nova] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3fcf6001-b52b-451f-8638-83543d41fb68 req-869493c4-87a9-4fc1-bc32-6b3cf946839c service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3fcf6001-b52b-451f-8638-83543d41fb68 req-869493c4-87a9-4fc1-bc32-6b3cf946839c service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-3fcf6001-b52b-451f-8638-83543d41fb68 req-869493c4-87a9-4fc1-bc32-6b3cf946839c service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] No waiting events found dispatching network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:41 user nova-compute[74534]: WARNING nova.compute.manager [req-3fcf6001-b52b-451f-8638-83543d41fb68 req-869493c4-87a9-4fc1-bc32-6b3cf946839c service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received unexpected event network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c for instance with vm_state active and task_state None.
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.121s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-1a86a746-78d2-4f2e-93a5-535f82ee1399 req-914e52cf-c28c-4f6f-a8bf-715fc2dd058e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1a86a746-78d2-4f2e-93a5-535f82ee1399 req-914e52cf-c28c-4f6f-a8bf-715fc2dd058e service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1a86a746-78d2-4f2e-93a5-535f82ee1399 req-914e52cf-c28c-4f6f-a8bf-715fc2dd058e service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1a86a746-78d2-4f2e-93a5-535f82ee1399 req-914e52cf-c28c-4f6f-a8bf-715fc2dd058e service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-1a86a746-78d2-4f2e-93a5-535f82ee1399 req-914e52cf-c28c-4f6f-a8bf-715fc2dd058e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:41 user nova-compute[74534]: WARNING nova.compute.manager [req-1a86a746-78d2-4f2e-93a5-535f82ee1399 req-914e52cf-c28c-4f6f-a8bf-715fc2dd058e service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received unexpected event network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c for instance with vm_state building and task_state spawning.
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:05:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.policy [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c5ca52592a646bbb11e735d7f500f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b6ac0b3c4d2f80c174892542ea49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:05:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Creating image(s)
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "/opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "/opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "/opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.294s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.235s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk 1073741824" returned: 0 in 0.097s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:05:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received event network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] No waiting events found dispatching network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:43 user nova-compute[74534]: WARNING nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received unexpected event network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 for instance with vm_state active and task_state None.
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:43 user nova-compute[74534]: WARNING nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state active and task_state None.
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:43 user nova-compute[74534]: WARNING nova.compute.manager [req-fdfd6561-2d8f-4abe-b9d1-bc8ccd4d1eb5 req-d428f35b-14d6-43ec-b0b1-3356f70ada25 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state active and task_state None.
Nov 02 12:05:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Cannot resize image /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Ensure instance console log exists: /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-5ee439f0-6f9e-415f-9d8c-c4f3bd8b7616 req-8ec778b8-c726-4efc-9d69-532916f09f87 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received event network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5ee439f0-6f9e-415f-9d8c-c4f3bd8b7616 req-8ec778b8-c726-4efc-9d69-532916f09f87 service nova] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5ee439f0-6f9e-415f-9d8c-c4f3bd8b7616 req-8ec778b8-c726-4efc-9d69-532916f09f87 service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5ee439f0-6f9e-415f-9d8c-c4f3bd8b7616 req-8ec778b8-c726-4efc-9d69-532916f09f87 service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-5ee439f0-6f9e-415f-9d8c-c4f3bd8b7616 req-8ec778b8-c726-4efc-9d69-532916f09f87 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] No waiting events found dispatching network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:43 user nova-compute[74534]: WARNING nova.compute.manager [req-5ee439f0-6f9e-415f-9d8c-c4f3bd8b7616 req-8ec778b8-c726-4efc-9d69-532916f09f87 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received unexpected event network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c for instance with vm_state active and task_state None.
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Successfully created port: d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fa9def86-66d2-49c8-bd1e-71a70c0ea81f req-d3300b38-5d20-49aa-9cfc-880218d42057 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa9def86-66d2-49c8-bd1e-71a70c0ea81f req-d3300b38-5d20-49aa-9cfc-880218d42057 service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa9def86-66d2-49c8-bd1e-71a70c0ea81f req-d3300b38-5d20-49aa-9cfc-880218d42057 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa9def86-66d2-49c8-bd1e-71a70c0ea81f req-d3300b38-5d20-49aa-9cfc-880218d42057 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-fa9def86-66d2-49c8-bd1e-71a70c0ea81f req-d3300b38-5d20-49aa-9cfc-880218d42057 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:43 user nova-compute[74534]: WARNING nova.compute.manager [req-fa9def86-66d2-49c8-bd1e-71a70c0ea81f req-d3300b38-5d20-49aa-9cfc-880218d42057 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received unexpected event network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c for instance with vm_state building and task_state spawning.
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Instance spawned successfully.
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:44 user nova-compute[74534]: INFO nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Took 10.47 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:44 user nova-compute[74534]: INFO nova.compute.manager [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Took 12.32 seconds to build instance.
Nov 02 12:05:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d350a9b7-903d-4849-a2c6-5691f7619bd8 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.467s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Successfully updated port: d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:05:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquired lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:05:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:05:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Updating instance_info_cache with network_info: [{"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Releasing lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Instance network_info: |[{"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Start _get_guest_xml network_info=[{"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:05:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1337830386',display_name='tempest-VolumesAssistedSnapshotsTest-server-1337830386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1337830386',id=10,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ+Axk1Nw4Qm/kvvRJIahj78glQYkPAJm5n/+nDp1s/rL65jJE3PMrECglK7rSaDh7XHHemigFd9mi2ESoX0LNjwxcg24mTS3VGMBDSRNwwSH8IwXPYG6JddSFuEayPsA==',key_name='tempest-keypair-1628464273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c26b6ac0b3c4d2f80c174892542ea49',ramdisk_id='',reservation_id='r-8baw4hp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-637081917',owner_user_name='tempest-VolumesAssistedSnapshotsTest-637081917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c5ca52592a646bbb11e735d7f500f51',uuid=60fef407-d916-4310-b722-465edfac927b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Converting VIF {"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=d2a603eb-455a-48dd-ab21-b4885e6a486f,network=Network(b075f9f2-da61-4573-b3bb-d05f976a0917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a603eb-45') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lazy-loading 'pci_devices' on Instance uuid 60fef407-d916-4310-b722-465edfac927b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:05:45 user nova-compute[74534]:   <uuid>60fef407-d916-4310-b722-465edfac927b</uuid>
Nov 02 12:05:45 user nova-compute[74534]:   <name>instance-0000000a</name>
Nov 02 12:05:45 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:05:45 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:05:45 user nova-compute[74534]:   <metadata>
Nov 02 12:05:45 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:05:45 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:05:45 user nova-compute[74534]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1337830386</nova:name>
Nov 02 12:05:45 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:05:45</nova:creationTime>
Nov 02 12:05:45 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:05:45 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:05:45 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:05:45 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:05:45 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:05:45 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:05:45 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:05:45 user nova-compute[74534]:       <nova:owner>
Nov 02 12:05:45 user nova-compute[74534]:         <nova:user uuid="6c5ca52592a646bbb11e735d7f500f51">tempest-VolumesAssistedSnapshotsTest-637081917-project-member</nova:user>
Nov 02 12:05:45 user nova-compute[74534]:         <nova:project uuid="2c26b6ac0b3c4d2f80c174892542ea49">tempest-VolumesAssistedSnapshotsTest-637081917</nova:project>
Nov 02 12:05:45 user nova-compute[74534]:       </nova:owner>
Nov 02 12:05:45 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:05:45 user nova-compute[74534]:       <nova:ports>
Nov 02 12:05:45 user nova-compute[74534]:         <nova:port uuid="d2a603eb-455a-48dd-ab21-b4885e6a486f">
Nov 02 12:05:45 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:05:45 user nova-compute[74534]:         </nova:port>
Nov 02 12:05:45 user nova-compute[74534]:       </nova:ports>
Nov 02 12:05:45 user nova-compute[74534]:     </nova:instance>
Nov 02 12:05:45 user nova-compute[74534]:   </metadata>
Nov 02 12:05:45 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:05:45 user nova-compute[74534]:     <system>
Nov 02 12:05:45 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:05:45 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:05:45 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:05:45 user nova-compute[74534]:       <entry name="serial">60fef407-d916-4310-b722-465edfac927b</entry>
Nov 02 12:05:45 user nova-compute[74534]:       <entry name="uuid">60fef407-d916-4310-b722-465edfac927b</entry>
Nov 02 12:05:45 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:05:45 user nova-compute[74534]:     </system>
Nov 02 12:05:45 user nova-compute[74534]:   </sysinfo>
Nov 02 12:05:45 user nova-compute[74534]:   <os>
Nov 02 12:05:45 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:05:45 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:05:45 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:05:45 user nova-compute[74534]:   </os>
Nov 02 12:05:45 user nova-compute[74534]:   <features>
Nov 02 12:05:45 user nova-compute[74534]:     <acpi/>
Nov 02 12:05:45 user nova-compute[74534]:     <apic/>
Nov 02 12:05:45 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:05:45 user nova-compute[74534]:   </features>
Nov 02 12:05:45 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:05:45 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:05:45 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:05:45 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:05:45 user nova-compute[74534]:   </clock>
Nov 02 12:05:45 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:05:45 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:05:45 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:05:45 user nova-compute[74534]:   </cpu>
Nov 02 12:05:45 user nova-compute[74534]:   <devices>
Nov 02 12:05:45 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:05:45 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:05:45 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk"/>
Nov 02 12:05:45 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:05:45 user nova-compute[74534]:     </disk>
Nov 02 12:05:45 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:05:45 user nova-compute[74534]:       <mac address="fa:16:3e:69:0d:e0"/>
Nov 02 12:05:45 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:45 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:05:45 user nova-compute[74534]:       <target dev="tapd2a603eb-45"/>
Nov 02 12:05:45 user nova-compute[74534]:     </interface>
Nov 02 12:05:45 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:05:45 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/console.log" append="off"/>
Nov 02 12:05:45 user nova-compute[74534]:     </serial>
Nov 02 12:05:45 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:05:45 user nova-compute[74534]:     <video>
Nov 02 12:05:45 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:05:45 user nova-compute[74534]:     </video>
Nov 02 12:05:45 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:05:45 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:05:45 user nova-compute[74534]:     </rng>
Nov 02 12:05:45 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:05:45 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:05:45 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:05:45 user nova-compute[74534]:     </memballoon>
Nov 02 12:05:45 user nova-compute[74534]:   </devices>
Nov 02 12:05:45 user nova-compute[74534]: </domain>
Nov 02 12:05:45 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1337830386',display_name='tempest-VolumesAssistedSnapshotsTest-server-1337830386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1337830386',id=10,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ+Axk1Nw4Qm/kvvRJIahj78glQYkPAJm5n/+nDp1s/rL65jJE3PMrECglK7rSaDh7XHHemigFd9mi2ESoX0LNjwxcg24mTS3VGMBDSRNwwSH8IwXPYG6JddSFuEayPsA==',key_name='tempest-keypair-1628464273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c26b6ac0b3c4d2f80c174892542ea49',ramdisk_id='',reservation_id='r-8baw4hp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-637081917',owner_user_name='tempest-VolumesAssistedSnapshotsTest-637081917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c5ca52592a646bbb11e735d7f500f51',uuid=60fef407-d916-4310-b722-465edfac927b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Converting VIF {"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=d2a603eb-455a-48dd-ab21-b4885e6a486f,network=Network(b075f9f2-da61-4573-b3bb-d05f976a0917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a603eb-45') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG os_vif [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=d2a603eb-455a-48dd-ab21-b4885e6a486f,network=Network(b075f9f2-da61-4573-b3bb-d05f976a0917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a603eb-45') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86e6e980-1c53-558c-84cc-b8689f7946bd', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2a603eb-45, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2a603eb-45, col_values=(('qos', UUID('7d894424-f322-4cd6-85fb-7a25b8693b4b')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2a603eb-45, col_values=(('external_ids', {'iface-id': 'd2a603eb-455a-48dd-ab21-b4885e6a486f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:0d:e0', 'vm-uuid': '60fef407-d916-4310-b722-465edfac927b'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:45 user nova-compute[74534]: INFO os_vif [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=d2a603eb-455a-48dd-ab21-b4885e6a486f,network=Network(b075f9f2-da61-4573-b3bb-d05f976a0917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a603eb-45')
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] No VIF found with MAC fa:16:3e:69:0d:e0, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-changed-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Refreshing instance network info cache due to event network-changed-d2a603eb-455a-48dd-ab21-b4885e6a486f. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] Acquiring lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] Acquired lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:45 user nova-compute[74534]: DEBUG nova.network.neutron [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Refreshing network info cache for port d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:05:46 user nova-compute[74534]: DEBUG nova.network.neutron [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Updated VIF entry in instance network info cache for port d2a603eb-455a-48dd-ab21-b4885e6a486f. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:05:46 user nova-compute[74534]: DEBUG nova.network.neutron [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Updating instance_info_cache with network_info: [{"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9e166c6b-72a4-4184-bb04-82121f7d21b7 req-57364419-d59d-4756-9700-605d9cb127e2 service nova] Releasing lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:05:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 0 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:05:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:05:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-6bab7ac7-aa97-4871-a451-8383648f2ba9 req-f314c079-5035-4c3e-b183-73334008e23b service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6bab7ac7-aa97-4871-a451-8383648f2ba9 req-f314c079-5035-4c3e-b183-73334008e23b service nova] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6bab7ac7-aa97-4871-a451-8383648f2ba9 req-f314c079-5035-4c3e-b183-73334008e23b service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6bab7ac7-aa97-4871-a451-8383648f2ba9 req-f314c079-5035-4c3e-b183-73334008e23b service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-6bab7ac7-aa97-4871-a451-8383648f2ba9 req-f314c079-5035-4c3e-b183-73334008e23b service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] No waiting events found dispatching network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:49 user nova-compute[74534]: WARNING nova.compute.manager [req-6bab7ac7-aa97-4871-a451-8383648f2ba9 req-f314c079-5035-4c3e-b183-73334008e23b service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received unexpected event network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 for instance with vm_state active and task_state None.
Nov 02 12:05:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:05:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:05:49 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 60fef407-d916-4310-b722-465edfac927b] Instance spawned successfully.
Nov 02 12:05:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:50 user nova-compute[74534]: INFO nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 02 12:05:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:05:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:50 user nova-compute[74534]: INFO nova.compute.manager [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Took 10.23 seconds to build instance.
Nov 02 12:05:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0c99628c-f139-487a-883e-9f8924db093e tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "60fef407-d916-4310-b722-465edfac927b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.416s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-b28f1476-8b14-4013-8979-36338e47d5bd req-78e39041-af82-49a3-a887-c98db3781c5b service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b28f1476-8b14-4013-8979-36338e47d5bd req-78e39041-af82-49a3-a887-c98db3781c5b service nova] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b28f1476-8b14-4013-8979-36338e47d5bd req-78e39041-af82-49a3-a887-c98db3781c5b service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b28f1476-8b14-4013-8979-36338e47d5bd req-78e39041-af82-49a3-a887-c98db3781c5b service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-b28f1476-8b14-4013-8979-36338e47d5bd req-78e39041-af82-49a3-a887-c98db3781c5b service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] No waiting events found dispatching network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:51 user nova-compute[74534]: WARNING nova.compute.manager [req-b28f1476-8b14-4013-8979-36338e47d5bd req-78e39041-af82-49a3-a887-c98db3781c5b service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received unexpected event network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 for instance with vm_state active and task_state None.
Nov 02 12:05:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 85b625b9-3a28-4916-a773-9797941f35d3 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updating instance_info_cache with network_info: [{"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-85b625b9-3a28-4916-a773-9797941f35d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:05:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-99c08737-06a9-4f51-bf23-2cf06254efae req-4ed4b321-9f07-4de5-87a3-11eb08909be5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-99c08737-06a9-4f51-bf23-2cf06254efae req-4ed4b321-9f07-4de5-87a3-11eb08909be5 service nova] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-99c08737-06a9-4f51-bf23-2cf06254efae req-4ed4b321-9f07-4de5-87a3-11eb08909be5 service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-99c08737-06a9-4f51-bf23-2cf06254efae req-4ed4b321-9f07-4de5-87a3-11eb08909be5 service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-99c08737-06a9-4f51-bf23-2cf06254efae req-4ed4b321-9f07-4de5-87a3-11eb08909be5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] No waiting events found dispatching network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:56 user nova-compute[74534]: WARNING nova.compute.manager [req-99c08737-06a9-4f51-bf23-2cf06254efae req-4ed4b321-9f07-4de5-87a3-11eb08909be5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received unexpected event network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 for instance with vm_state active and task_state None.
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] No waiting events found dispatching network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:58 user nova-compute[74534]: WARNING nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received unexpected event network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 for instance with vm_state active and task_state None.
Nov 02 12:05:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Acquiring lock "60fef407-d916-4310-b722-465edfac927b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] No waiting events found dispatching network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:58 user nova-compute[74534]: WARNING nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received unexpected event network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f for instance with vm_state active and task_state None.
Nov 02 12:05:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Acquiring lock "60fef407-d916-4310-b722-465edfac927b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] No waiting events found dispatching network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:05:58 user nova-compute[74534]: WARNING nova.compute.manager [req-b1e14fe7-3545-422b-96b0-9a8845bc8ddb req-5304e783-93a6-4cbb-b7a3-3a6f8819f87c service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received unexpected event network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f for instance with vm_state active and task_state None.
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:05:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:05:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7323MB free_disk=25.563129425048828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:05:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 85b625b9-3a28-4916-a773-9797941f35d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 44fb7ed3-c943-42b2-8254-00aebe23d744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 60fef407-d916-4310-b722-465edfac927b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:05:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.996s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "46a22e79-d865-4998-954c-23dfc93f7608" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "46a22e79-d865-4998-954c-23dfc93f7608" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:06:27 user nova-compute[74534]: INFO nova.compute.claims [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Claim successful on node user
Nov 02 12:06:27 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:06:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.policy [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9b5a220e5284d76b8a1ee606a2104fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c632d2880cae4fee92c4b408c9c2aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:06:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Creating image(s)
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "/opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "/opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "/opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk 1073741824" returned: 0 in 0.051s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Successfully created port: 3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Cannot resize image /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Ensure instance console log exists: /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Successfully updated port: 3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "refresh_cache-46a22e79-d865-4998-954c-23dfc93f7608" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquired lock "refresh_cache-46a22e79-d865-4998-954c-23dfc93f7608" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received event network-changed-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Refreshing instance network info cache due to event network-changed-3103ad5c-f9a6-4336-bf6c-56547d621afa. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] Acquiring lock "refresh_cache-46a22e79-d865-4998-954c-23dfc93f7608" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Updating instance_info_cache with network_info: [{"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Releasing lock "refresh_cache-46a22e79-d865-4998-954c-23dfc93f7608" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Instance network_info: |[{"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] Acquired lock "refresh_cache-46a22e79-d865-4998-954c-23dfc93f7608" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.neutron [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Refreshing network info cache for port 3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Start _get_guest_xml network_info=[{"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:06:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:06:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1429109745',display_name='tempest-VolumesActionsTest-instance-1429109745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1429109745',id=11,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c632d2880cae4fee92c4b408c9c2aff5',ramdisk_id='',reservation_id='r-e1o0kxd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-105983395',owner_user_name='tempest-VolumesActionsTest-105983395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:28Z,user_data=None,user_id='b9b5a220e5284d76b8a1ee606a2104fb',uuid=46a22e79-d865-4998-954c-23dfc93f7608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converting VIF {"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=3103ad5c-f9a6-4336-bf6c-56547d621afa,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3103ad5c-f9') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lazy-loading 'pci_devices' on Instance uuid 46a22e79-d865-4998-954c-23dfc93f7608 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:06:29 user nova-compute[74534]:   <uuid>46a22e79-d865-4998-954c-23dfc93f7608</uuid>
Nov 02 12:06:29 user nova-compute[74534]:   <name>instance-0000000b</name>
Nov 02 12:06:29 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:06:29 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:06:29 user nova-compute[74534]:   <metadata>
Nov 02 12:06:29 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:06:29 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:06:29 user nova-compute[74534]:       <nova:name>tempest-VolumesActionsTest-instance-1429109745</nova:name>
Nov 02 12:06:29 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:06:29</nova:creationTime>
Nov 02 12:06:29 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:06:29 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:06:29 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:06:29 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:06:29 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:06:29 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:06:29 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:06:29 user nova-compute[74534]:       <nova:owner>
Nov 02 12:06:29 user nova-compute[74534]:         <nova:user uuid="b9b5a220e5284d76b8a1ee606a2104fb">tempest-VolumesActionsTest-105983395-project-member</nova:user>
Nov 02 12:06:29 user nova-compute[74534]:         <nova:project uuid="c632d2880cae4fee92c4b408c9c2aff5">tempest-VolumesActionsTest-105983395</nova:project>
Nov 02 12:06:29 user nova-compute[74534]:       </nova:owner>
Nov 02 12:06:29 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:06:29 user nova-compute[74534]:       <nova:ports>
Nov 02 12:06:29 user nova-compute[74534]:         <nova:port uuid="3103ad5c-f9a6-4336-bf6c-56547d621afa">
Nov 02 12:06:29 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 12:06:29 user nova-compute[74534]:         </nova:port>
Nov 02 12:06:29 user nova-compute[74534]:       </nova:ports>
Nov 02 12:06:29 user nova-compute[74534]:     </nova:instance>
Nov 02 12:06:29 user nova-compute[74534]:   </metadata>
Nov 02 12:06:29 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:06:29 user nova-compute[74534]:     <system>
Nov 02 12:06:29 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:06:29 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:06:29 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:06:29 user nova-compute[74534]:       <entry name="serial">46a22e79-d865-4998-954c-23dfc93f7608</entry>
Nov 02 12:06:29 user nova-compute[74534]:       <entry name="uuid">46a22e79-d865-4998-954c-23dfc93f7608</entry>
Nov 02 12:06:29 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:06:29 user nova-compute[74534]:     </system>
Nov 02 12:06:29 user nova-compute[74534]:   </sysinfo>
Nov 02 12:06:29 user nova-compute[74534]:   <os>
Nov 02 12:06:29 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:06:29 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:06:29 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:06:29 user nova-compute[74534]:   </os>
Nov 02 12:06:29 user nova-compute[74534]:   <features>
Nov 02 12:06:29 user nova-compute[74534]:     <acpi/>
Nov 02 12:06:29 user nova-compute[74534]:     <apic/>
Nov 02 12:06:29 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:06:29 user nova-compute[74534]:   </features>
Nov 02 12:06:29 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:06:29 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:06:29 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:06:29 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:06:29 user nova-compute[74534]:   </clock>
Nov 02 12:06:29 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:06:29 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:06:29 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:06:29 user nova-compute[74534]:   </cpu>
Nov 02 12:06:29 user nova-compute[74534]:   <devices>
Nov 02 12:06:29 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:06:29 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:06:29 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk"/>
Nov 02 12:06:29 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:06:29 user nova-compute[74534]:     </disk>
Nov 02 12:06:29 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:06:29 user nova-compute[74534]:       <mac address="fa:16:3e:80:5f:6a"/>
Nov 02 12:06:29 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:06:29 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:06:29 user nova-compute[74534]:       <target dev="tap3103ad5c-f9"/>
Nov 02 12:06:29 user nova-compute[74534]:     </interface>
Nov 02 12:06:29 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:06:29 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/console.log" append="off"/>
Nov 02 12:06:29 user nova-compute[74534]:     </serial>
Nov 02 12:06:29 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:06:29 user nova-compute[74534]:     <video>
Nov 02 12:06:29 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:06:29 user nova-compute[74534]:     </video>
Nov 02 12:06:29 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:06:29 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:06:29 user nova-compute[74534]:     </rng>
Nov 02 12:06:29 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:06:29 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:06:29 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:06:29 user nova-compute[74534]:     </memballoon>
Nov 02 12:06:29 user nova-compute[74534]:   </devices>
Nov 02 12:06:29 user nova-compute[74534]: </domain>
Nov 02 12:06:29 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1429109745',display_name='tempest-VolumesActionsTest-instance-1429109745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1429109745',id=11,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c632d2880cae4fee92c4b408c9c2aff5',ramdisk_id='',reservation_id='r-e1o0kxd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-105983395',owner_user_name='tempest-VolumesActionsTest-105983395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:28Z,user_data=None,user_id='b9b5a220e5284d76b8a1ee606a2104fb',uuid=46a22e79-d865-4998-954c-23dfc93f7608,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converting VIF {"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=3103ad5c-f9a6-4336-bf6c-56547d621afa,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3103ad5c-f9') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG os_vif [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=3103ad5c-f9a6-4336-bf6c-56547d621afa,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3103ad5c-f9') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ee874ee-d085-538d-ab9d-cce75518bf87', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3103ad5c-f9, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3103ad5c-f9, col_values=(('qos', UUID('81b84ef4-269e-4f4e-a418-bd17475dab9a')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3103ad5c-f9, col_values=(('external_ids', {'iface-id': '3103ad5c-f9a6-4336-bf6c-56547d621afa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:5f:6a', 'vm-uuid': '46a22e79-d865-4998-954c-23dfc93f7608'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:29 user nova-compute[74534]: INFO os_vif [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=3103ad5c-f9a6-4336-bf6c-56547d621afa,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3103ad5c-f9')
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:06:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] No VIF found with MAC fa:16:3e:80:5f:6a, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:06:30 user nova-compute[74534]: DEBUG nova.network.neutron [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Updated VIF entry in instance network info cache for port 3103ad5c-f9a6-4336-bf6c-56547d621afa. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:30 user nova-compute[74534]: DEBUG nova.network.neutron [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Updating instance_info_cache with network_info: [{"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-140347ce-32ee-4ee4-950f-96926b0e6d27 req-fe9dcc27-08a2-4a37-ae83-107670cf991f service nova] Releasing lock "refresh_cache-46a22e79-d865-4998-954c-23dfc93f7608" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-d6eddaf2-db9b-4f6e-b406-71dc115aad12 req-07a5448d-2362-4cc4-9121-076aa60ba634 service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received event network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d6eddaf2-db9b-4f6e-b406-71dc115aad12 req-07a5448d-2362-4cc4-9121-076aa60ba634 service nova] Acquiring lock "46a22e79-d865-4998-954c-23dfc93f7608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d6eddaf2-db9b-4f6e-b406-71dc115aad12 req-07a5448d-2362-4cc4-9121-076aa60ba634 service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d6eddaf2-db9b-4f6e-b406-71dc115aad12 req-07a5448d-2362-4cc4-9121-076aa60ba634 service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-d6eddaf2-db9b-4f6e-b406-71dc115aad12 req-07a5448d-2362-4cc4-9121-076aa60ba634 service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] No waiting events found dispatching network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:06:31 user nova-compute[74534]: WARNING nova.compute.manager [req-d6eddaf2-db9b-4f6e-b406-71dc115aad12 req-07a5448d-2362-4cc4-9121-076aa60ba634 service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received unexpected event network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa for instance with vm_state building and task_state spawning.
Nov 02 12:06:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:06:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Instance spawned successfully.
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:06:33 user nova-compute[74534]: INFO nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:06:33 user nova-compute[74534]: INFO nova.compute.manager [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Took 5.93 seconds to build instance.
Nov 02 12:06:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8f8105c9-8e4a-4e5d-a959-f79b3bdca7a1 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "46a22e79-d865-4998-954c-23dfc93f7608" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.033s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-2bee77fa-2ab2-4dfd-bf4d-46817f410d0d req-fa6bfe8f-ca2f-498e-baed-8c3774d4600c service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received event network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2bee77fa-2ab2-4dfd-bf4d-46817f410d0d req-fa6bfe8f-ca2f-498e-baed-8c3774d4600c service nova] Acquiring lock "46a22e79-d865-4998-954c-23dfc93f7608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2bee77fa-2ab2-4dfd-bf4d-46817f410d0d req-fa6bfe8f-ca2f-498e-baed-8c3774d4600c service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2bee77fa-2ab2-4dfd-bf4d-46817f410d0d req-fa6bfe8f-ca2f-498e-baed-8c3774d4600c service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-2bee77fa-2ab2-4dfd-bf4d-46817f410d0d req-fa6bfe8f-ca2f-498e-baed-8c3774d4600c service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] No waiting events found dispatching network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:06:33 user nova-compute[74534]: WARNING nova.compute.manager [req-2bee77fa-2ab2-4dfd-bf4d-46817f410d0d req-fa6bfe8f-ca2f-498e-baed-8c3774d4600c service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received unexpected event network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa for instance with vm_state active and task_state None.
Nov 02 12:06:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:06:44 user nova-compute[74534]: INFO nova.compute.claims [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Claim successful on node user
Nov 02 12:06:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:06:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:06:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:06:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:06:45 user nova-compute[74534]: INFO nova.virt.block_device [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Booting with volume 2913465c-3024-49ec-8348-59aac2a68b84 at /dev/vda
Nov 02 12:06:45 user nova-compute[74534]: DEBUG nova.policy [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '863dd2b14fb645b098249136d726ac49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4495aa33c44917bfb5de654e542e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:06:45 user nova-compute[74534]: DEBUG os_brick.utils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:06:45 user nova-compute[74534]: INFO oslo.privsep.daemon [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpa29zkkne/privsep.sock']
Nov 02 12:06:45 user sudo[86264]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpa29zkkne/privsep.sock
Nov 02 12:06:45 user sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 12:06:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:45 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully created port: b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully created port: dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully created port: a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:06:46 user sudo[86264]: pam_unix(sudo:session): session closed for user root
Nov 02 12:06:46 user nova-compute[74534]: INFO oslo.privsep.daemon [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Spawned new privsep daemon via rootwrap
Nov 02 12:06:46 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 12:06:46 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 12:06:46 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 02 12:06:46 user nova-compute[74534]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86346
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9eb23b-2ffe-4356-b50f-cf612430fb47]: (2,) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[364591c9-b7bc-4616-bb73-169223f719dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:46 user nova-compute[74534]: WARNING os_brick.initiator.connectors.nvmeof [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[54136766-9b94-4f73-ac71-16e6934a9e32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac97833-f92b-4b6b-bb75-8c2caef418fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f2cdbb-d8d6-4045-96d1-93a1e8cc782f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:06:46 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:06:46 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3550d30f-fcb3-422f-b5a0-2fde1a86d259]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG os_brick.utils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== get_connector_properties: return (1746ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:06:46 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating existing volume attachment record: 13013287-8163-406f-be19-67767c2ec3ba {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:06:47 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully created port: fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:06:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:47 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully created port: 9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully updated port: b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-b63ba33b-30a3-4a5a-ad82-a446542e96a9. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:06:48 user nova-compute[74534]: INFO nova.compute.manager [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] instance snapshotting
Nov 02 12:06:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2b4bd4f3-cd48-46c6-b76d-b6615522e5ef req-1d305ea2-57b0-4a7c-b96d-b1d5fd1dd6b8 service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Beginning live snapshot process
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully updated port: 23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8awx4i6o/6656a5af1a5841da83b1d5c3676dbf0f.delta 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8awx4i6o/6656a5af1a5841da83b1d5c3676dbf0f.delta 1073741824" returned: 0 in 0.052s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:49 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 12:06:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74534) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 02 12:06:49 user nova-compute[74534]: INFO nova.virt.libvirt.host [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] UEFI support detected
Nov 02 12:06:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully updated port: 05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-23a19e19-7793-45b9-ac52-7948d610d85b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port 23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully updated port: dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] COPY block job progress, current cursor: 327680 final cursor: 75497472 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-05342184-c439-49b5-b432-825fb8202d12. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port 05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:06:51 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 12:06:51 user nova-compute[74534]: DEBUG nova.network.neutron [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8awx4i6o/6656a5af1a5841da83b1d5c3676dbf0f.delta /opt/stack/data/nova/instances/snapshots/tmp8awx4i6o/6656a5af1a5841da83b1d5c3676dbf0f {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG nova.network.neutron [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bb3ca959-ec28-4424-a988-a7067b260c3e req-a82942cb-a9fc-423a-b0b0-c563e95578e8 service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8awx4i6o/6656a5af1a5841da83b1d5c3676dbf0f.delta /opt/stack/data/nova/instances/snapshots/tmp8awx4i6o/6656a5af1a5841da83b1d5c3676dbf0f" returned: 0 in 0.713s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:51 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Snapshot extracted, beginning image upload
Nov 02 12:06:51 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully updated port: a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-dd647ef0-4d20-41aa-96bf-b9e8041c2c86. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG nova.network.neutron [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG nova.network.neutron [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lazy-loading 'flavor' on Instance uuid 85b625b9-3a28-4916-a773-9797941f35d3 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:52 user nova-compute[74534]: INFO nova.compute.manager [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Attaching volume e9fb5eb4-d15e-42c2-b1b3-8beda778807d to /dev/vdb
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updating instance_info_cache with network_info: [{"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG os_brick.utils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14b9c4-c5c6-473f-918d-5f52a11a5569]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully updated port: fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dddc9f4-9903-4a84-a071-001de69db212]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32f3f72-2404-4767-a86f-c15ec99d4ed3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64b1c85-e938-4607-b540-4780eb5f28f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:06:53 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fbd2d8-b21e-4fe2-bfa7-33d0110de0af]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG os_brick.utils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updating existing volume attachment record: 7fc5ba87-f89b-47cf-8d95-c211876d669e {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-daf775b9-6ad1-491c-9a3b-6d60095a2bbe req-c019e263-1258-4242-b1e2-6768ae450dbb service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Successfully updated port: 9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Snapshot image upload complete
Nov 02 12:06:54 user nova-compute[74534]: INFO nova.compute.manager [None req-0310e997-8cab-4cf5-8e94-218131303418 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Took 5.83 seconds to snapshot the instance on the hypervisor.
Nov 02 12:06:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received event network-changed-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Refreshing instance network info cache due to event network-changed-6bd2394c-d906-4662-a101-dc05b7f71de0. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] Acquiring lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] Acquired lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:54 user nova-compute[74534]: DEBUG nova.network.neutron [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Refreshing network info cache for port 6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updated VIF entry in instance network info cache for port 6bd2394c-d906-4662-a101-dc05b7f71de0. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680d1252-b9cd-4c58-acd6-4ef096afac84 req-47e62a39-0bb2-4d05-96c4-7d7155d7ea18 service nova] Releasing lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [{"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance network_info: |[{"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG nova.network.neutron [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updated VIF entry in instance network info cache for port fd56b57e-5bb6-4d2d-9618-4e3f38da11f8. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [{"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-changed-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Refreshing instance network info cache due to event network-changed-77f86a40-464c-4f30-a11d-abf8b4a7f8d4. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] Acquiring lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] Acquired lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Refreshing network info cache for port 77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-9e664875-3ea4-4a54-a7cc-1d24e551117b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port 9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updated VIF entry in instance network info cache for port 77f86a40-464c-4f30-a11d-abf8b4a7f8d4. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] Releasing lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-changed-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Refreshing instance network info cache due to event network-changed-eeff8901-03cf-47f3-b6ef-27d1abc1479a. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] Acquiring lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] Acquired lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Refreshing network info cache for port eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updated VIF entry in instance network info cache for port 9e664875-3ea4-4a54-a7cc-1d24e551117b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [{"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f005868-415e-49a9-aded-89c4a1072af4 req-9d37c0f0-102a-4d2c-8154-724bc4795d2a service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updated VIF entry in instance network info cache for port eeff8901-03cf-47f3-b6ef-27d1abc1479a. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3833e663-17d1-4622-a950-15bd66919d84 req-54163221-3c27-4582-b637-dca9834dbe14 service nova] Releasing lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-changed-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Refreshing instance network info cache due to event network-changed-540e495f-ada0-44bf-99e7-767cb2a0e193. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] Acquiring lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] Acquired lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Refreshing network info cache for port 540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing instance network info cache due to event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Updated VIF entry in instance network info cache for port 540e495f-ada0-44bf-99e7-767cb2a0e193. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Updating instance_info_cache with network_info: [{"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-810b837a-28ff-4c64-82be-a2ba66996ead req-3f1f478a-76a9-471a-bc83-9672af8769c7 service nova] Releasing lock "refresh_cache-2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updated VIF entry in instance network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36ce70c1-ee31-487b-bbd2-8add1f1a81d1 req-35e2f92c-c264-41d8-9e75-a897f59d8bfc service nova] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:06:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:06:59 user nova-compute[74534]: INFO nova.compute.manager [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] instance snapshotting
Nov 02 12:07:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Beginning live snapshot process
Nov 02 12:07:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:07:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=6754MB free_disk=25.404632568359375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 85b625b9-3a28-4916-a773-9797941f35d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 44fb7ed3-c943-42b2-8254-00aebe23d744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 60fef407-d916-4310-b722-465edfac927b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 46a22e79-d865-4998-954c-23dfc93f7608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 20efc112-72c3-4d40-ae01-d1e827bc2fc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:07:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.168s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9qhrm4n5/4ce3dd01adaa4fd0beb575b3c707841d.delta 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9qhrm4n5/4ce3dd01adaa4fd0beb575b3c707841d.delta 1073741824" returned: 0 in 0.051s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:01 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 12:07:01 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:07:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:07:02 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 12:07:02 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9qhrm4n5/4ce3dd01adaa4fd0beb575b3c707841d.delta /opt/stack/data/nova/instances/snapshots/tmp9qhrm4n5/4ce3dd01adaa4fd0beb575b3c707841d {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:02 user nova-compute[74534]: INFO nova.compute.manager [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Attaching volume 064bf791-6451-45fe-bfe3-9c7f85d7c38e to /dev/vdb
Nov 02 12:07:02 user nova-compute[74534]: DEBUG os_brick.utils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c32ae6-78b2-4cba-9704-05270da7bdf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6521a8-387d-49c0-9553-0d133d6fbf31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d87458-d2b8-45eb-b885-a0621f4d82a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b668000-213f-4095-8a5f-d02fb993cd1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:02 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:07:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d5b87d-d068-455c-a182-d5f98c324dff]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:07:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:07:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:07:03 user nova-compute[74534]: DEBUG os_brick.utils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:03 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating existing volume attachment record: d8b06ce0-6e68-47ef-a460-ba2504722344 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:07:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9qhrm4n5/4ce3dd01adaa4fd0beb575b3c707841d.delta /opt/stack/data/nova/instances/snapshots/tmp9qhrm4n5/4ce3dd01adaa4fd0beb575b3c707841d" returned: 0 in 0.391s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:03 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Snapshot extracted, beginning image upload
Nov 02 12:07:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Snapshot image upload complete
Nov 02 12:07:05 user nova-compute[74534]: INFO nova.compute.manager [None req-7fe81b5a-c216-4b78-be06-a8d963507306 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Took 5.94 seconds to snapshot the instance on the hypervisor.
Nov 02 12:07:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:07 user nova-compute[74534]: INFO nova.virt.block_device [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Booting with volume e54361e7-bef3-48c7-9ba9-07f6cc8690bc at /dev/vdb
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG nova.objects.instance [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG os_brick.utils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[93338129-b24b-431c-9a01-ea8918654d3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[db859472-7eeb-484d-b2af-e8aecf2dc9e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e558bd81-184c-4b88-971f-557ea95f534e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1156f382-45fa-4dca-81d2-c58e3cee063b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:08 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:07:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9015ab62-e7a8-4650-b564-ebc6244623fa]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG os_brick.utils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating existing volume attachment record: e2bdb304-da75-4978-8267-bf10e47df669 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:08 user nova-compute[74534]: INFO nova.compute.manager [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Attaching volume eb252b9d-8711-44a0-92d6-717fe4120b5f to /dev/vdb
Nov 02 12:07:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-changed-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Refreshing instance network info cache due to event network-changed-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] Acquiring lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] Acquired lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Refreshing network info cache for port e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Updated VIF entry in instance network info cache for port e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Updating instance_info_cache with network_info: [{"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-969ab7ed-e911-4550-b845-03871d0f73cd req-536efef0-e630-489e-a953-1cfb0a410bb5 service nova] Releasing lock "refresh_cache-44fb7ed3-c943-42b2-8254-00aebe23d744" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connector [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Factory for ISCSI on None {{(pid=74534) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQwOVjev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:13 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:13 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:13 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fdee80-22a1-4572-b730-78df36befd7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:07:13 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00e221-9f64-4a41-bcc5-25331ab45a78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d] added
Nov 02 12:07:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[223e2e79-a6b6-4e8d-ba64-fa10e49971d2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[305cda93-f919-49df-99da-73fe6b80196e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQwOVjev {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQwOVjev" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[790caa29-9b49-41e7-b623-fc4484226605]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQwOVjev'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d7eaef-540b-45cc-819c-fe112beaacdd]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e6b717-8580-498b-8667-8cad2efb9672]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:07:13 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:07:13 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:13 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:07:13 user nova-compute[74534]: 
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0c58f-32c4-47a3-af9f-38f01e70e2f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260]
Nov 02 12:07:13 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[90619ab6-40e1-48de-9ea5-396b99feed8d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d51899-6d59-4fd7-aee6-49be8f421ee5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[401db976-61fe-4105-b464-cb7e86356196]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQwOVjev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc9f13b-4965-447e-a4d9-ce1b61533243]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fca294-254a-42f1-a52d-46416efef876]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd152e80-a90c-4d44-96e4-053bfafb90a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2299ac12-f112-4094-899e-a1f15a71806c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:14 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:07:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db72c8-2645-41d4-82fa-8227728be7a1]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Updating existing volume attachment record: e1f4ded9-4a7b-458d-9e16-cced98a63b02 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:07:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26537316566363636', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537316566363636', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lazy-loading 'flavor' on Instance uuid 85b625b9-3a28-4916-a773-9797941f35d3 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:07:15 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:15 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:07:15 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:07:15 user nova-compute[74534]:   <serial>e9fb5eb4-d15e-42c2-b1b3-8beda778807d</serial>
Nov 02 12:07:15 user nova-compute[74534]: </disk>
Nov 02 12:07:15 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] No VIF found with MAC fa:16:3e:91:f6:1e, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-changed-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Refreshing instance network info cache due to event network-changed-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] Acquiring lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] Acquired lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Refreshing network info cache for port 8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "interface-33b75f56-25f3-42b9-a699-5cf4e3bf4f53-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "interface-33b75f56-25f3-42b9-a699-5cf4e3bf4f53-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'flavor' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfhdpPuj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:22 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:22 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:22 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd5d7b-13c2-4d52-ba80-0e31e566481e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:07:22 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d6da60-fe0b-4ae2-b59c-14728490021d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e] added
Nov 02 12:07:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ae0dd-4f84-4c44-beb6-f9a689d570af]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'pci_requests' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f4fb7-19e5-4468-9772-97674796d859]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfhdpPuj {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.objects.base [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Object Instance<33b75f56-25f3-42b9-a699-5cf4e3bf4f53> lazy-loaded attributes: flavor,pci_requests {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfhdpPuj" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1349f9-07db-4298-a346-8541f4970afa]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LfhdpPuj'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[969cd0f6-38a5-4306-8f33-a3a553c50704]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updated VIF entry in instance network info cache for port 8e801a89-2f1c-41ef-85c2-67e6ed38ce9c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d888b8-0fc4-459b-be98-e5bb57445fbc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b2e5946b-4757-4a8e-ab1b-38c8007eaeda req-c7ed45b6-268c-40c3-82f2-7af4a0ae61ca service nova] Releasing lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.policy [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90050c453aad4f63b4a7615a0ff0f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c15ccf99034cb9bdc6ca3e19c1ac29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8569bf0-9e35-4650-922d-d10aaa5747f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]
Nov 02 12:07:23 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c3b7b-a969-44c8-bb1c-aefe1a182f84]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[467d028d-fa15-4127-87a2-c1b516c15499]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:23 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:23 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba763be0-18ac-4912-91a3-c8d0bf60c8e9]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfhdpPuj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7844d557-f786-495f-b4cf-e3be875a6962 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.286s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lazy-loading 'flavor' on Instance uuid 44fb7ed3-c943-42b2-8254-00aebe23d744 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:23 user nova-compute[74534]: INFO nova.compute.manager [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Attaching volume 3e7e42b9-7d79-475f-823f-c535d74402e1 to /dev/sdc
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.utils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Successfully created port: 4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f863f8db-609c-4bbc-bf8e-a153d574dcf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8608073-b586-4136-98e7-18a903c95a81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[78261509-be69-43d8-b49c-99693c1a30db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e59424-319a-42d2-97d2-e6b384b18590]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:23 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:07:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2773950f-dd45-40d1-ba41-327b4fefc251]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG os_brick.utils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:23 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Updating existing volume attachment record: 22d132a9-6408-4d71-a451-706a14650852 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Successfully updated port: 4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26534643030636661', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534643030636661', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquired lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-changed-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Refreshing instance network info cache due to event network-changed-4a473cae-8dcf-49ab-9021-50d379fed620. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] Acquiring lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:07:24 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:24 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:07:24 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:07:24 user nova-compute[74534]:   <serial>064bf791-6451-45fe-bfe3-9c7f85d7c38e</serial>
Nov 02 12:07:24 user nova-compute[74534]: </disk>
Nov 02 12:07:24 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No VIF found with MAC fa:16:3e:72:88:5c, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Releasing lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] Acquired lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.network.neutron [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Refreshing network info cache for port 4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converting VIF {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG os_vif [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ac546bf-69a1-5882-a380-431abfb09352', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a473cae-8d, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a473cae-8d, col_values=(('qos', UUID('df778a80-9e56-40b2-83ac-125cf1503d44')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a473cae-8d, col_values=(('external_ids', {'iface-id': '4a473cae-8dcf-49ab-9021-50d379fed620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:21:47', 'vm-uuid': '33b75f56-25f3-42b9-a699-5cf4e3bf4f53'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: INFO os_vif [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d')
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converting VIF {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] attach device xml: <interface type="ethernet">
Nov 02 12:07:25 user nova-compute[74534]:   <mac address="fa:16:3e:d9:21:47"/>
Nov 02 12:07:25 user nova-compute[74534]:   <model type="virtio"/>
Nov 02 12:07:25 user nova-compute[74534]:   <mtu size="1442"/>
Nov 02 12:07:25 user nova-compute[74534]:   <target dev="tap4a473cae-8d"/>
Nov 02 12:07:25 user nova-compute[74534]: </interface>
Nov 02 12:07:25 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No BDM found with device name hda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No VIF found with MAC fa:16:3e:31:a9:8a, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:07:25 user nova-compute[74534]:   <nova:package version="0.0.0"/>
Nov 02 12:07:25 user nova-compute[74534]:   <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:07:25 user nova-compute[74534]:   <nova:creationTime>2023-11-02 12:07:25</nova:creationTime>
Nov 02 12:07:25 user nova-compute[74534]:   <nova:flavor name="m1.tiny">
Nov 02 12:07:25 user nova-compute[74534]:     <nova:memory>512</nova:memory>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:disk>1</nova:disk>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:swap>0</nova:swap>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:vcpus>1</nova:vcpus>
Nov 02 12:07:25 user nova-compute[74534]:   </nova:flavor>
Nov 02 12:07:25 user nova-compute[74534]:   <nova:owner>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:07:25 user nova-compute[74534]:   </nova:owner>
Nov 02 12:07:25 user nova-compute[74534]:   <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:07:25 user nova-compute[74534]:   <nova:ports>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:07:25 user nova-compute[74534]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:07:25 user nova-compute[74534]:     </nova:port>
Nov 02 12:07:25 user nova-compute[74534]:     <nova:port uuid="4a473cae-8dcf-49ab-9021-50d379fed620">
Nov 02 12:07:25 user nova-compute[74534]:       <nova:ip type="fixed" address="10.10.10.238" ipVersion="4"/>
Nov 02 12:07:25 user nova-compute[74534]:     </nova:port>
Nov 02 12:07:25 user nova-compute[74534]:   </nova:ports>
Nov 02 12:07:25 user nova-compute[74534]: </nova:instance>
Nov 02 12:07:25 user nova-compute[74534]:  {{(pid=74534) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 12:07:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc4fa0fc-efc0-4db8-815c-6d7ff6c6a622 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "interface-33b75f56-25f3-42b9-a699-5cf4e3bf4f53-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.180s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG nova.network.neutron [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updated VIF entry in instance network info cache for port 4a473cae-8dcf-49ab-9021-50d379fed620. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG nova.network.neutron [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-67541132-c793-4afc-bd85-351fbe22fbe6 req-e8e730b0-8830-47d5-9b02-378734226eb6 service nova] Releasing lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:26 user nova-compute[74534]: WARNING nova.compute.manager [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received unexpected event network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 for instance with vm_state active and task_state None.
Nov 02 12:07:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:26 user nova-compute[74534]: WARNING nova.compute.manager [req-2822f9b4-48ae-4bc0-a7ea-42498187844a req-bf8303ea-299b-4517-8e96-eedd01bb0119 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received unexpected event network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 for instance with vm_state active and task_state None.
Nov 02 12:07:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ac006827-1fd2-4de8-97cc-9fa9d69e8161 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.163s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:28 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'flavor' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:28 user nova-compute[74534]: INFO nova.virt.block_device [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Booting with volume 9c20659e-03f6-4563-b449-5c95dbd99d17 at /dev/vdc
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG os_brick.utils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572c531-f174-4665-a98e-662d8652d136]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea44ef0-746c-4b8f-8e78-86e23fc9cbea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f67889-1333-4b83-baa7-7ace01bd178f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfc8e2-2cc9-4e5c-bd6d-a2f0e5d09e4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:29 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[13033e17-1a95-48cf-87c5-15d45625b35a]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG os_brick.utils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating existing volume attachment record: 0f505e8c-aac5-4f92-b973-b6c57cec8c99 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:29 user nova-compute[74534]: INFO nova.compute.manager [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Terminating instance
Nov 02 12:07:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:29 user nova-compute[74534]: INFO nova.compute.manager [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Attaching volume 5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf to /dev/vdb
Nov 02 12:07:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-e879c291-decb-4f35-b76f-8917bca55944 req-40d943ca-332c-46be-a543-4412b9c1d139 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received event network-vif-unplugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e879c291-decb-4f35-b76f-8917bca55944 req-40d943ca-332c-46be-a543-4412b9c1d139 service nova] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e879c291-decb-4f35-b76f-8917bca55944 req-40d943ca-332c-46be-a543-4412b9c1d139 service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e879c291-decb-4f35-b76f-8917bca55944 req-40d943ca-332c-46be-a543-4412b9c1d139 service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-e879c291-decb-4f35-b76f-8917bca55944 req-40d943ca-332c-46be-a543-4412b9c1d139 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] No waiting events found dispatching network-vif-unplugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-e879c291-decb-4f35-b76f-8917bca55944 req-40d943ca-332c-46be-a543-4412b9c1d139 service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received event network-vif-unplugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:07:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Instance destroyed successfully.
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lazy-loading 'resources' on Instance uuid 85b625b9-3a28-4916-a773-9797941f35d3 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:04:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-514979507',display_name='tempest-DeleteServersTestJSON-server-514979507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-514979507',id=1,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e910bd90b24252b3ddb17f71ebfca5',ramdisk_id='',reservation_id='r-0aspby1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2109873852',owner_user_name='tempest-DeleteServersTestJSON-2109873852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:16Z,user_data=None,user_id='08838f4489be468fa1625807a9136789',uuid=85b625b9-3a28-4916-a773-9797941f35d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Converting VIF {"id": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "address": "fa:16:3e:91:f6:1e", "network": {"id": "7e0d2024-e3a3-4c0a-b427-29756c45d9a6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-346762973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e910bd90b24252b3ddb17f71ebfca5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f9e205-ed", "ovs_interfaceid": "b5f9e205-ed68-4f2c-a16e-4d4128024804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f6:1e,bridge_name='br-int',has_traffic_filtering=True,id=b5f9e205-ed68-4f2c-a16e-4d4128024804,network=Network(7e0d2024-e3a3-4c0a-b427-29756c45d9a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f9e205-ed') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_vif [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f6:1e,bridge_name='br-int',has_traffic_filtering=True,id=b5f9e205-ed68-4f2c-a16e-4d4128024804,network=Network(7e0d2024-e3a3-4c0a-b427-29756c45d9a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f9e205-ed') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f9e205-ed, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=128263b9-c7b2-4fdd-86e0-330f57a3cb3b) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:30 user nova-compute[74534]: INFO os_vif [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f6:1e,bridge_name='br-int',has_traffic_filtering=True,id=b5f9e205-ed68-4f2c-a16e-4d4128024804,network=Network(7e0d2024-e3a3-4c0a-b427-29756c45d9a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f9e205-ed')
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQwOVjev', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:30 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae91d6f6-ef2a-4ac1-9367-871a3e2b19ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:07:30 user nova-compute[74534]: No targets found.
Nov 02 12:07:30 user nova-compute[74534]: iSNS:
Nov 02 12:07:30 user nova-compute[74534]: No targets found.
Nov 02 12:07:30 user nova-compute[74534]: STATIC:
Nov 02 12:07:30 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:07:30 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:07:30 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:07:30 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d
Nov 02 12:07:30 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:07:30 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:07:30 user nova-compute[74534]: FIRMWARE:
Nov 02 12:07:30 user nova-compute[74534]: No targets found.
Nov 02 12:07:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:07:30 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:07:30 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c58a26-25b5-4a3b-a6e7-fefa11c367c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f67ca1-2b17-4494-a919-7199bdf3c403]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:30 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d (non-flash)
Nov 02 12:07:30 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180666b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c995b0aa-b190-4db1-bf2e-b8d600ef97ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[818e2790-0cae-4009-8b5e-56a8b745c6a7]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaad3488-b5a3-4624-b7cb-5722ca1c8eca]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edc7435-7df4-41ed-ae5c-809d0bc8ed29]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ac0548-7af6-4567-8d3c-8b8502b35f00]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7287828b-7188-4eba-9318-0a90aca626d0]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260]
Nov 02 12:07:30 user nova-compute[74534]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9fb5eb4-d15e-42c2-b1b3-8beda778807d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f4679-6d8a-43b0-ad59-550d5116cc4c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] <== disconnect_volume: return (306ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:07:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Deleting instance files /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3_del
Nov 02 12:07:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Deletion of /opt/stack/data/nova/instances/85b625b9-3a28-4916-a773-9797941f35d3_del complete
Nov 02 12:07:30 user nova-compute[74534]: INFO nova.compute.manager [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 02 12:07:30 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:07:30 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:31 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Took 0.71 seconds to deallocate network for instance.
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-8af0bb2f-1607-4535-88de-791405a781ed req-1600a389-6227-45dd-88de-8d140584361f service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received event network-vif-deleted-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:31 user nova-compute[74534]: INFO nova.compute.manager [req-8af0bb2f-1607-4535-88de-791405a781ed req-1600a389-6227-45dd-88de-8d140584361f service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Neutron deleted interface b5f9e205-ed68-4f2c-a16e-4d4128024804; detaching it from the instance and deleting it from the info cache
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-8af0bb2f-1607-4535-88de-791405a781ed req-1600a389-6227-45dd-88de-8d140584361f service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-8af0bb2f-1607-4535-88de-791405a781ed req-1600a389-6227-45dd-88de-8d140584361f service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Detach interface failed, port_id=b5f9e205-ed68-4f2c-a16e-4d4128024804, reason: Instance 85b625b9-3a28-4916-a773-9797941f35d3 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received event network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] Acquiring lock "85b625b9-3a28-4916-a773-9797941f35d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] Lock "85b625b9-3a28-4916-a773-9797941f35d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] No waiting events found dispatching network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:31 user nova-compute[74534]: WARNING nova.compute.manager [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Received unexpected event network-vif-plugged-b5f9e205-ed68-4f2c-a16e-4d4128024804 for instance with vm_state active and task_state deleting.
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-changed-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Refreshing instance network info cache due to event network-changed-d2a603eb-455a-48dd-ab21-b4885e6a486f. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] Acquiring lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] Acquired lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Refreshing network info cache for port d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:07:32 user nova-compute[74534]: DEBUG nova.network.neutron [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Updated VIF entry in instance network info cache for port d2a603eb-455a-48dd-ab21-b4885e6a486f. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:07:32 user nova-compute[74534]: DEBUG nova.network.neutron [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Updating instance_info_cache with network_info: [{"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b19b248-a8d8-48c9-86c7-6ff563a796c4 req-bc62a916-8ab2-48dc-a241-30f4c7424c0e service nova] Releasing lock "refresh_cache-60fef407-d916-4310-b722-465edfac927b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFIloVBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:39 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[07544fb5-e258-4290-9440-3dde38d4ac6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:07:39 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919aa9c-a218-4bd4-8a30-3599aceda25a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f] added
Nov 02 12:07:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c307a6-b5b3-4aaa-9104-ce1851ea1588]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c967076-a39e-43be-b9d7-5f82ddc0b339]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFIloVBn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFIloVBn" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15194c3-7490-4d60-bdb0-954ae935703b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFIloVBn'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fa4f0-50bc-4948-abb5-ce6c7b6fbe0f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9cc5c2-4005-4afa-9226-e766987b2dd7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6af2ef-a209-4f5b-b8d4-9ad3217b6d35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260]
Nov 02 12:07:40 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49f84db-a40c-455c-86ab-61cb653ed119]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bef0af-54b5-420b-96b2-1139dfdf6aba]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:40 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:40 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fdcb37-080f-4eee-8b5b-94c940a8f0d8]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFIloVBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Acquiring lock "60fef407-d916-4310-b722-465edfac927b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "60fef407-d916-4310-b722-465edfac927b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG nova.objects.instance [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lazy-loading 'flavor' on Instance uuid 60fef407-d916-4310-b722-465edfac927b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "60fef407-d916-4310-b722-465edfac927b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:40 user nova-compute[74534]: INFO nova.compute.manager [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] [instance: 85b625b9-3a28-4916-a773-9797941f35d3] Took 9.84 seconds to detach 1 volumes for instance.
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.utils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c7e8d-bdd2-4880-bb85-4c83c6650962]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d9954-8c89-4f93-98a7-1c8fe89fa9f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c92c424-419d-4047-9867-e86b615d28b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d516745-7ab9-4ee1-8274-0680b30560fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23636366533353138', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636366533353138', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:41 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e6b5b5-c49d-4bdd-b158-d04f65541147]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG os_brick.utils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating existing volume attachment record: a0e71a18-dc7c-4d4d-828b-cf1a810b1e88 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.objects.instance [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:07:41 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:41 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:07:41 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:07:41 user nova-compute[74534]:   <serial>eb252b9d-8711-44a0-92d6-717fe4120b5f</serial>
Nov 02 12:07:41 user nova-compute[74534]: </disk>
Nov 02 12:07:41 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5c0f0cb6-b5b5-4395-9a1c-cba9e297e4de tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5c0f0cb6-b5b5-4395-9a1c-cba9e297e4de tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5c0f0cb6-b5b5-4395-9a1c-cba9e297e4de tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5c0f0cb6-b5b5-4395-9a1c-cba9e297e4de tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74534) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.objects.instance [None req-5c0f0cb6-b5b5-4395-9a1c-cba9e297e4de tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Acquiring lock "60fef407-d916-4310-b722-465edfac927b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "60fef407-d916-4310-b722-465edfac927b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:41 user nova-compute[74534]: INFO nova.compute.manager [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] Attaching volume 7d732031-5543-49fd-b0f3-11a8787f7e41 to /dev/vdb
Nov 02 12:07:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No VIF found with MAC fa:16:3e:d7:77:65, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.643s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:41 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Deleted allocations for instance 85b625b9-3a28-4916-a773-9797941f35d3
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b42789e-17de-4be9-8d7e-2a4554ee399e req-dd5ab22f-9a19-48db-b07b-203df0566ed1 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b42789e-17de-4be9-8d7e-2a4554ee399e req-dd5ab22f-9a19-48db-b07b-203df0566ed1 service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b42789e-17de-4be9-8d7e-2a4554ee399e req-dd5ab22f-9a19-48db-b07b-203df0566ed1 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b42789e-17de-4be9-8d7e-2a4554ee399e req-dd5ab22f-9a19-48db-b07b-203df0566ed1 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b42789e-17de-4be9-8d7e-2a4554ee399e req-dd5ab22f-9a19-48db-b07b-203df0566ed1 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:41 user nova-compute[74534]: WARNING nova.compute.manager [req-7b42789e-17de-4be9-8d7e-2a4554ee399e req-dd5ab22f-9a19-48db-b07b-203df0566ed1 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state active and task_state powering-off.
Nov 02 12:07:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c906670-cd0c-4990-baa6-9080f5147819 tempest-DeleteServersTestJSON-2109873852 tempest-DeleteServersTestJSON-2109873852-project-member] Lock "85b625b9-3a28-4916-a773-9797941f35d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.661s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:42 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance destroyed successfully.
Nov 02 12:07:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5c0f0cb6-b5b5-4395-9a1c-cba9e297e4de tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:07:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5c0f0cb6-b5b5-4395-9a1c-cba9e297e4de tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.928s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-4468b58f-77eb-4df9-ac23-0c9f6cd8022d req-5bd26353-269c-41fc-aed7-88d2d9c44633 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4468b58f-77eb-4df9-ac23-0c9f6cd8022d req-5bd26353-269c-41fc-aed7-88d2d9c44633 service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4468b58f-77eb-4df9-ac23-0c9f6cd8022d req-5bd26353-269c-41fc-aed7-88d2d9c44633 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4468b58f-77eb-4df9-ac23-0c9f6cd8022d req-5bd26353-269c-41fc-aed7-88d2d9c44633 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-4468b58f-77eb-4df9-ac23-0c9f6cd8022d req-5bd26353-269c-41fc-aed7-88d2d9c44633 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:43 user nova-compute[74534]: WARNING nova.compute.manager [req-4468b58f-77eb-4df9-ac23-0c9f6cd8022d req-5bd26353-269c-41fc-aed7-88d2d9c44633 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state stopped and task_state None.
Nov 02 12:07:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQcBHmxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:45 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:45 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:45 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e877aa6-2f14-47be-b4f3-d44d55ec199a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:07:45 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46b5b94-bc59-4761-89ed-438f90479168]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1] added
Nov 02 12:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[91514565-3bbe-401d-b93a-4785e6de5b76]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f2c133-00e2-4bcc-b4c3-95f4f92fb783]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQcBHmxu {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQcBHmxu" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f63d82-9ac2-4369-a435-b3818f2e39a2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQcBHmxu'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5b41b807-0150-4b63-a8a4-978e7e4fe514 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.056s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28b8a1b-9dea-4791-9926-9927dc8219a8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c26dd3-fc44-473d-815c-53bb279998dc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:45 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:45 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8ae41b-eb08-4505-976e-59623aa5d606]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260]
Nov 02 12:07:45 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac02f588-cd4a-41db-a28d-88aab4ec93d8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.utils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5c421-cae8-4876-93fc-945f62deffe2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:45 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:45 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:45 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:45 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f566e3c-9e58-4a4a-91bc-1c31ba77c5a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2bf35-92d3-4482-b427-8d609ed84179]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQcBHmxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be74c0f-f0f1-4e22-974e-b262a851bc77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b43e62-c82b-4bef-9183-70592275824e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a93bf-09d9-41d0-a2f0-89a7a6766666]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:07:45 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e2bf82-3cbe-4148-841b-e911bafbadad]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG os_brick.utils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:45 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] Updating existing volume attachment record: 91f0a2ec-fded-4c10-8c76-db5a0723e22d {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23561366530636531', 'path': '/dev/sdd'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561366530636531', 'path': '/dev/sdd'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG nova.objects.instance [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lazy-loading 'flavor' on Instance uuid 44fb7ed3-c943-42b2-8254-00aebe23d744 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:07:46 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:46 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:07:46 user nova-compute[74534]:   <target dev="sdc" bus="scsi"/>
Nov 02 12:07:46 user nova-compute[74534]:   <serial>3e7e42b9-7d79-475f-823f-c535d74402e1</serial>
Nov 02 12:07:46 user nova-compute[74534]:   <address type="drive" controller="0" unit="2"/>
Nov 02 12:07:46 user nova-compute[74534]: </disk>
Nov 02 12:07:46 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] No BDM found with device name sda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] No VIF found with MAC fa:16:3e:a8:3c:b9, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:07:48 user nova-compute[74534]: INFO nova.compute.claims [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Claim successful on node user
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:07:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.policy [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cb6a67fcb13459880727c825793db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcb68ce88ae4280ba6feb308b7c53da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:07:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Creating image(s)
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "/opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk 1073741824" returned: 0 in 0.069s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Successfully created port: 2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Cannot resize image /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Ensure instance console log exists: /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Successfully updated port: 2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquired lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-changed-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Refreshing instance network info cache due to event network-changed-2960630e-2789-4bfd-b46c-f1899ddd68ce. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] Acquiring lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Updating instance_info_cache with network_info: [{"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Releasing lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Instance network_info: |[{"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] Acquired lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Refreshing network info cache for port 2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Start _get_guest_xml network_info=[{"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9b1424a6-9573-4c9b-a774-d6d535fb0c59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.077s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:50 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:07:50 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-928612153',display_name='tempest-AttachVolumeNegativeTest-server-928612153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-928612153',id=13,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEAE1HrSlVRxXlrVV0IisJm/IKGyMfpRg2SEtVQx4Iow2OpAisvs5sVLMhRqs8Mg3J9v/qfpsPWvRSQ3iVDwSog/iLrVVdXbXHqKchNETw/VE+D4Md1vHGiepuij3TTMA==',key_name='tempest-keypair-1370197256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-yyqh6ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=0be2a397-b69d-46fc-a5c3-5f50f92a6781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:2f:40,bridge_name='br-int',has_traffic_filtering=True,id=2960630e-2789-4bfd-b46c-f1899ddd68ce,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960630e-27') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.objects.instance [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'pci_devices' on Instance uuid 0be2a397-b69d-46fc-a5c3-5f50f92a6781 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:07:50 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Creating image(s)
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Ensure instance console log exists: /opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Start _get_guest_xml network_info=[{"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': '13013287-8163-406f-be19-67767c2ec3ba', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRqOgYro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20efc112-72c3-4d40-ae01-d1e827bc2fc2', 'attached_at': '', 'detached_at': '', 'volume_id': '2913465c-3024-49ec-8348-59aac2a68b84', 'serial': '2913465c-3024-49ec-8348-59aac2a68b84'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'guest_format': None, 'attachment_id': 'e2bdb304-da75-4978-8267-bf10e47df669', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZehFadf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20efc112-72c3-4d40-ae01-d1e827bc2fc2', 'attached_at': '', 'detached_at': '', 'volume_id': 'e54361e7-bef3-48c7-9ba9-07f6cc8690bc', 'serial': 'e54361e7-bef3-48c7-9ba9-07f6cc8690bc'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'guest_format': None, 'attachment_id': '0f505e8c-aac5-4f92-b973-b6c57cec8c99', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYpuGrRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20efc112-72c3-4d40-ae01-d1e827bc2fc2', 'attached_at': '', 'detached_at': '', 'volume_id': '9c20659e-03f6-4563-b449-5c95dbd99d17', 'serial': '9c20659e-03f6-4563-b449-5c95dbd99d17'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:07:50 user nova-compute[74534]:   <uuid>0be2a397-b69d-46fc-a5c3-5f50f92a6781</uuid>
Nov 02 12:07:50 user nova-compute[74534]:   <name>instance-0000000d</name>
Nov 02 12:07:50 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:07:50 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:07:50 user nova-compute[74534]:   <metadata>
Nov 02 12:07:50 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:07:50 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:07:50 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeNegativeTest-server-928612153</nova:name>
Nov 02 12:07:50 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:07:50</nova:creationTime>
Nov 02 12:07:50 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:07:50 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:07:50 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:07:50 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:07:50 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:07:50 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:07:50 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:07:50 user nova-compute[74534]:       <nova:owner>
Nov 02 12:07:50 user nova-compute[74534]:         <nova:user uuid="3cb6a67fcb13459880727c825793db65">tempest-AttachVolumeNegativeTest-322425016-project-member</nova:user>
Nov 02 12:07:50 user nova-compute[74534]:         <nova:project uuid="8fcb68ce88ae4280ba6feb308b7c53da">tempest-AttachVolumeNegativeTest-322425016</nova:project>
Nov 02 12:07:50 user nova-compute[74534]:       </nova:owner>
Nov 02 12:07:50 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:07:50 user nova-compute[74534]:       <nova:ports>
Nov 02 12:07:50 user nova-compute[74534]:         <nova:port uuid="2960630e-2789-4bfd-b46c-f1899ddd68ce">
Nov 02 12:07:50 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:07:50 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:50 user nova-compute[74534]:       </nova:ports>
Nov 02 12:07:50 user nova-compute[74534]:     </nova:instance>
Nov 02 12:07:50 user nova-compute[74534]:   </metadata>
Nov 02 12:07:50 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:07:50 user nova-compute[74534]:     <system>
Nov 02 12:07:50 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:07:50 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:07:50 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:07:50 user nova-compute[74534]:       <entry name="serial">0be2a397-b69d-46fc-a5c3-5f50f92a6781</entry>
Nov 02 12:07:50 user nova-compute[74534]:       <entry name="uuid">0be2a397-b69d-46fc-a5c3-5f50f92a6781</entry>
Nov 02 12:07:50 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:07:50 user nova-compute[74534]:     </system>
Nov 02 12:07:50 user nova-compute[74534]:   </sysinfo>
Nov 02 12:07:50 user nova-compute[74534]:   <os>
Nov 02 12:07:50 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:07:50 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:07:50 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:07:50 user nova-compute[74534]:   </os>
Nov 02 12:07:50 user nova-compute[74534]:   <features>
Nov 02 12:07:50 user nova-compute[74534]:     <acpi/>
Nov 02 12:07:50 user nova-compute[74534]:     <apic/>
Nov 02 12:07:50 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:07:50 user nova-compute[74534]:   </features>
Nov 02 12:07:50 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:07:50 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:07:50 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:07:50 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:07:50 user nova-compute[74534]:   </clock>
Nov 02 12:07:50 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:07:50 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:07:50 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:07:50 user nova-compute[74534]:   </cpu>
Nov 02 12:07:50 user nova-compute[74534]:   <devices>
Nov 02 12:07:50 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:07:50 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:07:50 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk"/>
Nov 02 12:07:50 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:07:50 user nova-compute[74534]:     </disk>
Nov 02 12:07:50 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:50 user nova-compute[74534]:       <mac address="fa:16:3e:49:2f:40"/>
Nov 02 12:07:50 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:50 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:50 user nova-compute[74534]:       <target dev="tap2960630e-27"/>
Nov 02 12:07:50 user nova-compute[74534]:     </interface>
Nov 02 12:07:50 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:07:50 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/console.log" append="off"/>
Nov 02 12:07:50 user nova-compute[74534]:     </serial>
Nov 02 12:07:50 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:07:50 user nova-compute[74534]:     <video>
Nov 02 12:07:50 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:50 user nova-compute[74534]:     </video>
Nov 02 12:07:50 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:07:50 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:07:50 user nova-compute[74534]:     </rng>
Nov 02 12:07:50 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:07:50 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:07:50 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:07:50 user nova-compute[74534]:     </memballoon>
Nov 02 12:07:50 user nova-compute[74534]:   </devices>
Nov 02 12:07:50 user nova-compute[74534]: </domain>
Nov 02 12:07:50 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-928612153',display_name='tempest-AttachVolumeNegativeTest-server-928612153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-928612153',id=13,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEAE1HrSlVRxXlrVV0IisJm/IKGyMfpRg2SEtVQx4Iow2OpAisvs5sVLMhRqs8Mg3J9v/qfpsPWvRSQ3iVDwSog/iLrVVdXbXHqKchNETw/VE+D4Md1vHGiepuij3TTMA==',key_name='tempest-keypair-1370197256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-yyqh6ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=0be2a397-b69d-46fc-a5c3-5f50f92a6781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:2f:40,bridge_name='br-int',has_traffic_filtering=True,id=2960630e-2789-4bfd-b46c-f1899ddd68ce,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960630e-27') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_vif [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2f:40,bridge_name='br-int',has_traffic_filtering=True,id=2960630e-2789-4bfd-b46c-f1899ddd68ce,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960630e-27') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fee7a6c-77bf-5c27-bd64-fa0ac7c8f55e', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:50 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:07:50 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2960630e-27, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2960630e-27, col_values=(('qos', UUID('5f36f232-8814-4cb7-8ac0-2d546691f10c')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2960630e-27, col_values=(('external_ids', {'iface-id': '2960630e-2789-4bfd-b46c-f1899ddd68ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:2f:40', 'vm-uuid': '0be2a397-b69d-46fc-a5c3-5f50f92a6781'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRqOgYro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:50 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:50 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:50 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:50 user nova-compute[74534]: INFO os_vif [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2f:40,bridge_name='br-int',has_traffic_filtering=True,id=2960630e-2789-4bfd-b46c-f1899ddd68ce,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960630e-27')
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b896aba-c68b-4e61-98c3-c985887143e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:07:50 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6702be75-bd41-497f-9ec9-dd7023befc7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84] added
Nov 02 12:07:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb5a5b1-1d30-46f2-bb4f-5f022b2e41ad]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No VIF found with MAC fa:16:3e:49:2f:40, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[be99d7f3-d108-4f62-b70a-fc24132cb2a4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRqOgYro {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRqOgYro" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c1c16-294d-48c9-adc5-bdd1b713cb29]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SRqOgYro'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0c47fe-1d4d-4b67-9727-0ec2dd6260d5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8772a323-19b3-4644-a9ae-2255056bfecc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:50 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:50 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:50 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:50 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5e4e6c-2401-4ee5-bc6a-0b237d9bfa8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260]
Nov 02 12:07:51 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:51 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c83a0-07c7-4f80-ae68-b780aa92438f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG nova.network.neutron [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Updated VIF entry in instance network info cache for port 2960630e-2789-4bfd-b46c-f1899ddd68ce. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG nova.network.neutron [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Updating instance_info_cache with network_info: [{"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-23f7a76a-b7e2-49f4-b2a1-51952541c451 req-4baa7f6f-03db-4186-bb67-d5fb6255ac70 service nova] Releasing lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b13872-6c15-4ba1-a1d1-f375eab82658]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:51 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:51 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:51 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:51 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:51 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:51 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:51 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:51 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca298872-1441-41f9-838e-a50dafa3e630]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:07:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRqOgYro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:52 user nova-compute[74534]: INFO nova.compute.manager [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Detaching volume 3e7e42b9-7d79-475f-823f-c535d74402e1
Nov 02 12:07:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26664643965643661', 'path': '/dev/sde'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664643965643661', 'path': '/dev/sde'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:52 user nova-compute[74534]: INFO nova.virt.block_device [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Attempting to driver detach volume 3e7e42b9-7d79-475f-823f-c535d74402e1 from mountpoint /dev/sdc
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZehFadf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:52 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:52 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:52 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Attempting to detach device sdc from instance 44fb7ed3-c943-42b2-8254-00aebe23d744 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:07:52 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:52 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:07:52 user nova-compute[74534]:   <target dev="sdc" bus="scsi"/>
Nov 02 12:07:52 user nova-compute[74534]:   <serial>3e7e42b9-7d79-475f-823f-c535d74402e1</serial>
Nov 02 12:07:52 user nova-compute[74534]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 12:07:52 user nova-compute[74534]: </disk>
Nov 02 12:07:52 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Successfully detached device sdc from instance 44fb7ed3-c943-42b2-8254-00aebe23d744 from the persistent domain config.
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 44fb7ed3-c943-42b2-8254-00aebe23d744 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:07:52 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:52 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:07:52 user nova-compute[74534]:   <target dev="sdc" bus="scsi"/>
Nov 02 12:07:52 user nova-compute[74534]:   <serial>3e7e42b9-7d79-475f-823f-c535d74402e1</serial>
Nov 02 12:07:52 user nova-compute[74534]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 12:07:52 user nova-compute[74534]: </disk>
Nov 02 12:07:52 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac552b42-4861-4bca-b175-820c8b659371]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:07:52 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfca95f-500f-4dcd-b4f1-b14419b2f15e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc] added
Nov 02 12:07:52 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10c13ae-0eb7-46f2-9c27-666e025fbd8e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b426d232-4d67-40fc-8780-41845c9f4924]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZehFadf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZehFadf" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c68bdb-c571-43f6-bf31-9b45a4d2a010]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XZehFadf'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[79be735c-ce69-4b89-b69f-70590056abb6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-8a4e6ecf-0350-4d79-b18a-bf212ba49434 req-a554ed43-bfa8-4769-a99b-31f257e1d081 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8a4e6ecf-0350-4d79-b18a-bf212ba49434 req-a554ed43-bfa8-4769-a99b-31f257e1d081 service nova] Acquiring lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8a4e6ecf-0350-4d79-b18a-bf212ba49434 req-a554ed43-bfa8-4769-a99b-31f257e1d081 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8a4e6ecf-0350-4d79-b18a-bf212ba49434 req-a554ed43-bfa8-4769-a99b-31f257e1d081 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-8a4e6ecf-0350-4d79-b18a-bf212ba49434 req-a554ed43-bfa8-4769-a99b-31f257e1d081 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] No waiting events found dispatching network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:52 user nova-compute[74534]: WARNING nova.compute.manager [req-8a4e6ecf-0350-4d79-b18a-bf212ba49434 req-a554ed43-bfa8-4769-a99b-31f257e1d081 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received unexpected event network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce for instance with vm_state building and task_state spawning.
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[136193c0-4767-4d55-b34c-4af01818bfa5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ac0ec3-a48a-4e4e-b8ce-abc85d6e4ed0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260]
Nov 02 12:07:52 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:52 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f64d65-8ecb-4a0c-ba83-bab541b8dc03]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b96d8-8ed3-4890-ba01-1c00b56c5b78]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:07:52 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:52 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:07:52 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed15f504-6f79-4998-a463-2252c14bcb24]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZehFadf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:07:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 44fb7ed3-c943-42b2-8254-00aebe23d744 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23534333930363330', 'path': '/dev/sdf'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534333930363330', 'path': '/dev/sdf'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYpuGrRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:07:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:07:53 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b984a93-5298-4742-ba0b-7acce2f78c0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:07:53 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aab552-d7db-410f-8520-ebfbb065167b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17] added
Nov 02 12:07:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe46794-78c6-4097-ab83-2d39f214f210]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d315b-c75b-45ff-9a98-f5505c3f3058]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYpuGrRO {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYpuGrRO" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[400e7bc3-0fff-4fcb-8881-334547ed75f6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYpuGrRO'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ffc651-bfa7-4b9e-b881-4aca6a9b0e03]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec94a0b4-f116-41d5-b7fb-1bf5da8d694e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:07:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:07:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dc3dee-b294-4287-9704-59b284f220fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260]
Nov 02 12:07:53 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260] successful.
Nov 02 12:07:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0c8ffc-f6e4-44b2-a1b4-f2db8900992c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cf39f0-743d-43d7-aa2b-6f5fd1315219]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:07:53 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:07:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:07:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e9cd27-923a-46b2-83cc-eab12b1599ac]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYpuGrRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-ae299a5f-ce3f-42c7-9e78-8969a3eb5f16 req-ea55f2a3-e585-450c-be92-d3e1763b76b1 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ae299a5f-ce3f-42c7-9e78-8969a3eb5f16 req-ea55f2a3-e585-450c-be92-d3e1763b76b1 service nova] Acquiring lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ae299a5f-ce3f-42c7-9e78-8969a3eb5f16 req-ea55f2a3-e585-450c-be92-d3e1763b76b1 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ae299a5f-ce3f-42c7-9e78-8969a3eb5f16 req-ea55f2a3-e585-450c-be92-d3e1763b76b1 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-ae299a5f-ce3f-42c7-9e78-8969a3eb5f16 req-ea55f2a3-e585-450c-be92-d3e1763b76b1 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] No waiting events found dispatching network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:54 user nova-compute[74534]: WARNING nova.compute.manager [req-ae299a5f-ce3f-42c7-9e78-8969a3eb5f16 req-ea55f2a3-e585-450c-be92-d3e1763b76b1 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received unexpected event network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce for instance with vm_state building and task_state spawning.
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:07:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Instance spawned successfully.
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:07:54 user nova-compute[74534]: INFO nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 02 12:07:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:07:54 user nova-compute[74534]: INFO nova.compute.manager [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Took 6.63 seconds to build instance.
Nov 02 12:07:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65c6e68a-6c88-447c-a7aa-03c07cc62657 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.736s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23932386565343835', 'path': '/dev/sdg'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932386565343835', 'path': '/dev/sdg'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:1d:57,bridge_name='br-int',has_traffic_filtering=True,id=b63ba33b-30a3-4a5a-ad82-a446542e96a9,network=Network(3308069e-715c-4071-ad60-f63f247e0dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63ba33b-30') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=23a19e19-7793-45b9-ac52-7948d610d85b,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23a19e19-77') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:29:43,bridge_name='br-int',has_traffic_filtering=True,id=05342184-c439-49b5-b432-825fb8202d12,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05342184-c4') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:4d,bridge_name='br-int',has_traffic_filtering=True,id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd647ef0-4d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:04:52,bridge_name='br-int',has_traffic_filtering=True,id=a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64bd6ed-ab') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:16:5a,bridge_name='br-int',has_traffic_filtering=True,id=fd56b57e-5bb6-4d2d-9618-4e3f38da11f8,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56b57e-5b') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4d:8e,bridge_name='br-int',has_traffic_filtering=True,id=9e664875-3ea4-4a54-a7cc-1d24e551117b,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e664875-3e') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.objects.instance [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lazy-loading 'pci_devices' on Instance uuid 20efc112-72c3-4d40-ae01-d1e827bc2fc2 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:07:55 user nova-compute[74534]:   <uuid>20efc112-72c3-4d40-ae01-d1e827bc2fc2</uuid>
Nov 02 12:07:55 user nova-compute[74534]:   <name>instance-0000000c</name>
Nov 02 12:07:55 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:07:55 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:07:55 user nova-compute[74534]:   <metadata>
Nov 02 12:07:55 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:07:55 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:07:55 user nova-compute[74534]:       <nova:name>tempest-device-tagging-server-500656982</nova:name>
Nov 02 12:07:55 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:07:50</nova:creationTime>
Nov 02 12:07:55 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:07:55 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:07:55 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:07:55 user nova-compute[74534]:       <nova:owner>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:user uuid="863dd2b14fb645b098249136d726ac49">tempest-TaggedBootDevicesTest-35755980-project-member</nova:user>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:project uuid="8b4495aa33c44917bfb5de654e542e57">tempest-TaggedBootDevicesTest-35755980</nova:project>
Nov 02 12:07:55 user nova-compute[74534]:       </nova:owner>
Nov 02 12:07:55 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:07:55 user nova-compute[74534]:       <nova:ports>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:port uuid="b63ba33b-30a3-4a5a-ad82-a446542e96a9">
Nov 02 12:07:55 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:07:55 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:port uuid="23a19e19-7793-45b9-ac52-7948d610d85b">
Nov 02 12:07:55 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Nov 02 12:07:55 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:port uuid="05342184-c439-49b5-b432-825fb8202d12">
Nov 02 12:07:55 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Nov 02 12:07:55 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:port uuid="dd647ef0-4d20-41aa-96bf-b9e8041c2c86">
Nov 02 12:07:55 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.182" ipVersion="4"/>
Nov 02 12:07:55 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:port uuid="a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1">
Nov 02 12:07:55 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.218" ipVersion="4"/>
Nov 02 12:07:55 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:port uuid="fd56b57e-5bb6-4d2d-9618-4e3f38da11f8">
Nov 02 12:07:55 user nova-compute[74534]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 12:07:55 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:55 user nova-compute[74534]:         <nova:port uuid="9e664875-3ea4-4a54-a7cc-1d24e551117b">
Nov 02 12:07:55 user nova-compute[74534]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 12:07:55 user nova-compute[74534]:         </nova:port>
Nov 02 12:07:55 user nova-compute[74534]:       </nova:ports>
Nov 02 12:07:55 user nova-compute[74534]:     </nova:instance>
Nov 02 12:07:55 user nova-compute[74534]:   </metadata>
Nov 02 12:07:55 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:07:55 user nova-compute[74534]:     <system>
Nov 02 12:07:55 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:07:55 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:07:55 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:07:55 user nova-compute[74534]:       <entry name="serial">20efc112-72c3-4d40-ae01-d1e827bc2fc2</entry>
Nov 02 12:07:55 user nova-compute[74534]:       <entry name="uuid">20efc112-72c3-4d40-ae01-d1e827bc2fc2</entry>
Nov 02 12:07:55 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:07:55 user nova-compute[74534]:     </system>
Nov 02 12:07:55 user nova-compute[74534]:   </sysinfo>
Nov 02 12:07:55 user nova-compute[74534]:   <os>
Nov 02 12:07:55 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:07:55 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:07:55 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:07:55 user nova-compute[74534]:   </os>
Nov 02 12:07:55 user nova-compute[74534]:   <features>
Nov 02 12:07:55 user nova-compute[74534]:     <acpi/>
Nov 02 12:07:55 user nova-compute[74534]:     <apic/>
Nov 02 12:07:55 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:07:55 user nova-compute[74534]:   </features>
Nov 02 12:07:55 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:07:55 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:07:55 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:07:55 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:07:55 user nova-compute[74534]:   </clock>
Nov 02 12:07:55 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:07:55 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:07:55 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:07:55 user nova-compute[74534]:   </cpu>
Nov 02 12:07:55 user nova-compute[74534]:   <devices>
Nov 02 12:07:55 user nova-compute[74534]:     <disk type="file" device="cdrom">
Nov 02 12:07:55 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 12:07:55 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2/disk.config"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="hda" bus="ide"/>
Nov 02 12:07:55 user nova-compute[74534]:     </disk>
Nov 02 12:07:55 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:07:55 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:55 user nova-compute[74534]:       <source dev="/dev/sde"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <serial>2913465c-3024-49ec-8348-59aac2a68b84</serial>
Nov 02 12:07:55 user nova-compute[74534]:     </disk>
Nov 02 12:07:55 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:07:55 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:55 user nova-compute[74534]:       <source dev="/dev/sdf"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <serial>e54361e7-bef3-48c7-9ba9-07f6cc8690bc</serial>
Nov 02 12:07:55 user nova-compute[74534]:     </disk>
Nov 02 12:07:55 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:07:55 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:07:55 user nova-compute[74534]:       <source dev="/dev/sdg"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="vdc" bus="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <serial>9c20659e-03f6-4563-b449-5c95dbd99d17</serial>
Nov 02 12:07:55 user nova-compute[74534]:     </disk>
Nov 02 12:07:55 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:55 user nova-compute[74534]:       <mac address="fa:16:3e:40:1d:57"/>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="tapb63ba33b-30"/>
Nov 02 12:07:55 user nova-compute[74534]:     </interface>
Nov 02 12:07:55 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:55 user nova-compute[74534]:       <mac address="fa:16:3e:d5:9f:cb"/>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="tap23a19e19-77"/>
Nov 02 12:07:55 user nova-compute[74534]:     </interface>
Nov 02 12:07:55 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:55 user nova-compute[74534]:       <mac address="fa:16:3e:bd:29:43"/>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="tap05342184-c4"/>
Nov 02 12:07:55 user nova-compute[74534]:     </interface>
Nov 02 12:07:55 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:55 user nova-compute[74534]:       <mac address="fa:16:3e:2e:66:4d"/>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="tapdd647ef0-4d"/>
Nov 02 12:07:55 user nova-compute[74534]:     </interface>
Nov 02 12:07:55 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:55 user nova-compute[74534]:       <mac address="fa:16:3e:07:04:52"/>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="tapa64bd6ed-ab"/>
Nov 02 12:07:55 user nova-compute[74534]:     </interface>
Nov 02 12:07:55 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:55 user nova-compute[74534]:       <mac address="fa:16:3e:7b:16:5a"/>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="tapfd56b57e-5b"/>
Nov 02 12:07:55 user nova-compute[74534]:     </interface>
Nov 02 12:07:55 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:07:55 user nova-compute[74534]:       <mac address="fa:16:3e:af:4d:8e"/>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:07:55 user nova-compute[74534]:       <target dev="tap9e664875-3e"/>
Nov 02 12:07:55 user nova-compute[74534]:     </interface>
Nov 02 12:07:55 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:07:55 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2/console.log" append="off"/>
Nov 02 12:07:55 user nova-compute[74534]:     </serial>
Nov 02 12:07:55 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:07:55 user nova-compute[74534]:     <video>
Nov 02 12:07:55 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:07:55 user nova-compute[74534]:     </video>
Nov 02 12:07:55 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:07:55 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:07:55 user nova-compute[74534]:     </rng>
Nov 02 12:07:55 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:07:55 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:07:55 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:07:55 user nova-compute[74534]:     </memballoon>
Nov 02 12:07:55 user nova-compute[74534]:   </devices>
Nov 02 12:07:55 user nova-compute[74534]: </domain>
Nov 02 12:07:55 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:1d:57,bridge_name='br-int',has_traffic_filtering=True,id=b63ba33b-30a3-4a5a-ad82-a446542e96a9,network=Network(3308069e-715c-4071-ad60-f63f247e0dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63ba33b-30') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:1d:57,bridge_name='br-int',has_traffic_filtering=True,id=b63ba33b-30a3-4a5a-ad82-a446542e96a9,network=Network(3308069e-715c-4071-ad60-f63f247e0dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63ba33b-30') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28ea31d6-a2c0-5cf6-b309-c63411a9e679', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb63ba33b-30, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb63ba33b-30, col_values=(('qos', UUID('97709023-cdd3-42dd-a095-2acc2b8b69ed')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb63ba33b-30, col_values=(('external_ids', {'iface-id': 'b63ba33b-30a3-4a5a-ad82-a446542e96a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:1d:57', 'vm-uuid': '20efc112-72c3-4d40-ae01-d1e827bc2fc2'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: INFO os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:1d:57,bridge_name='br-int',has_traffic_filtering=True,id=b63ba33b-30a3-4a5a-ad82-a446542e96a9,network=Network(3308069e-715c-4071-ad60-f63f247e0dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63ba33b-30')
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=23a19e19-7793-45b9-ac52-7948d610d85b,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23a19e19-77') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=23a19e19-7793-45b9-ac52-7948d610d85b,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23a19e19-77') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32b9b128-4d79-5f70-b01d-8e7f72667b97', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23a19e19-77, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23a19e19-77, col_values=(('qos', UUID('d277352f-47ee-4b79-9890-aa5daacadd6f')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23a19e19-77, col_values=(('external_ids', {'iface-id': '23a19e19-7793-45b9-ac52-7948d610d85b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:9f:cb', 'vm-uuid': '20efc112-72c3-4d40-ae01-d1e827bc2fc2'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: INFO os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=23a19e19-7793-45b9-ac52-7948d610d85b,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23a19e19-77')
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:29:43,bridge_name='br-int',has_traffic_filtering=True,id=05342184-c439-49b5-b432-825fb8202d12,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05342184-c4') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:29:43,bridge_name='br-int',has_traffic_filtering=True,id=05342184-c439-49b5-b432-825fb8202d12,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05342184-c4') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e839506f-c12f-5c0b-9cf4-05348e6bb307', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05342184-c4, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05342184-c4, col_values=(('qos', UUID('2bc09551-269a-4ed2-aaf3-1123f34bccdf')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05342184-c4, col_values=(('external_ids', {'iface-id': '05342184-c439-49b5-b432-825fb8202d12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:29:43', 'vm-uuid': '20efc112-72c3-4d40-ae01-d1e827bc2fc2'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: INFO os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:29:43,bridge_name='br-int',has_traffic_filtering=True,id=05342184-c439-49b5-b432-825fb8202d12,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05342184-c4')
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:4d,bridge_name='br-int',has_traffic_filtering=True,id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd647ef0-4d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:4d,bridge_name='br-int',has_traffic_filtering=True,id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd647ef0-4d') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '077e329d-51a6-5dc1-8dd1-98bba304c866', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd647ef0-4d, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd647ef0-4d, col_values=(('qos', UUID('48529139-cc85-4e33-a4b2-0c95db3e42a1')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd647ef0-4d, col_values=(('external_ids', {'iface-id': 'dd647ef0-4d20-41aa-96bf-b9e8041c2c86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:66:4d', 'vm-uuid': '20efc112-72c3-4d40-ae01-d1e827bc2fc2'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: INFO os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:4d,bridge_name='br-int',has_traffic_filtering=True,id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd647ef0-4d')
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:04:52,bridge_name='br-int',has_traffic_filtering=True,id=a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64bd6ed-ab') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:04:52,bridge_name='br-int',has_traffic_filtering=True,id=a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64bd6ed-ab') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b05c967-dece-51ec-acc6-ac45f2168bac', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa64bd6ed-ab, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa64bd6ed-ab, col_values=(('qos', UUID('8e072b28-e899-4c6c-a879-b227542d5d0d')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa64bd6ed-ab, col_values=(('external_ids', {'iface-id': 'a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:04:52', 'vm-uuid': '20efc112-72c3-4d40-ae01-d1e827bc2fc2'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: INFO os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:04:52,bridge_name='br-int',has_traffic_filtering=True,id=a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64bd6ed-ab')
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:16:5a,bridge_name='br-int',has_traffic_filtering=True,id=fd56b57e-5bb6-4d2d-9618-4e3f38da11f8,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56b57e-5b') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:16:5a,bridge_name='br-int',has_traffic_filtering=True,id=fd56b57e-5bb6-4d2d-9618-4e3f38da11f8,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56b57e-5b') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '143c24a6-94dc-5ee8-9a42-cf35a3fc61b3', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd56b57e-5b, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd56b57e-5b, col_values=(('qos', UUID('7eb0cdd1-685c-4dec-a78d-543837507ce8')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd56b57e-5b, col_values=(('external_ids', {'iface-id': 'fd56b57e-5bb6-4d2d-9618-4e3f38da11f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:16:5a', 'vm-uuid': '20efc112-72c3-4d40-ae01-d1e827bc2fc2'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: INFO os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:16:5a,bridge_name='br-int',has_traffic_filtering=True,id=fd56b57e-5bb6-4d2d-9618-4e3f38da11f8,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56b57e-5b')
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4d:8e,bridge_name='br-int',has_traffic_filtering=True,id=9e664875-3ea4-4a54-a7cc-1d24e551117b,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e664875-3e') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4d:8e,bridge_name='br-int',has_traffic_filtering=True,id=9e664875-3ea4-4a54-a7cc-1d24e551117b,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e664875-3e') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e50fc5c1-16dc-55f5-8c8e-5165682d843b', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e664875-3e, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e664875-3e, col_values=(('qos', UUID('e02d57f0-8b40-44ce-99ec-bbc0dd34c857')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e664875-3e, col_values=(('external_ids', {'iface-id': '9e664875-3ea4-4a54-a7cc-1d24e551117b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:4d:8e', 'vm-uuid': '20efc112-72c3-4d40-ae01-d1e827bc2fc2'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:55 user nova-compute[74534]: INFO os_vif [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4d:8e,bridge_name='br-int',has_traffic_filtering=True,id=9e664875-3ea4-4a54-a7cc-1d24e551117b,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e664875-3e')
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] No BDM found with device name hda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] No VIF found with MAC fa:16:3e:40:1d:57, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] No VIF found with MAC fa:16:3e:07:04:52, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:07:55 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Using config drive
Nov 02 12:07:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Creating config drive at /opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2/disk.config
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyjcq8_47 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyjcq8_47" returned: 0 in 0.068s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "45b47223-abde-4927-8ad3-1389fed70985" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:07:56 user nova-compute[74534]: INFO nova.compute.claims [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Claim successful on node user
Nov 02 12:07:57 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:07:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:07:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG nova.policy [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'caf5cde0e75e444da00c7bcda4bcdd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ccb20fcd184ecebd3707d9d93c8817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:07:57 user nova-compute[74534]: INFO nova.virt.block_device [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Booting with blank volume at /dev/vda
Nov 02 12:07:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-94ca3d18-6dfe-42db-9e09-93657a11e5a1 req-63fda18d-20d3-4d67-a27b-5c283d63fd5a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94ca3d18-6dfe-42db-9e09-93657a11e5a1 req-63fda18d-20d3-4d67-a27b-5c283d63fd5a service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94ca3d18-6dfe-42db-9e09-93657a11e5a1 req-63fda18d-20d3-4d67-a27b-5c283d63fd5a service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94ca3d18-6dfe-42db-9e09-93657a11e5a1 req-63fda18d-20d3-4d67-a27b-5c283d63fd5a service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-94ca3d18-6dfe-42db-9e09-93657a11e5a1 req-63fda18d-20d3-4d67-a27b-5c283d63fd5a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:58 user nova-compute[74534]: WARNING nova.compute.manager [req-94ca3d18-6dfe-42db-9e09-93657a11e5a1 req-63fda18d-20d3-4d67-a27b-5c283d63fd5a service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 for instance with vm_state building and task_state spawning.
Nov 02 12:07:58 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Successfully created port: 7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-657191cd-86e1-4e86-8d4a-465c0a18825b req-4a106e53-5986-491f-9e8c-d809f0c85fd6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-657191cd-86e1-4e86-8d4a-465c0a18825b req-4a106e53-5986-491f-9e8c-d809f0c85fd6 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-657191cd-86e1-4e86-8d4a-465c0a18825b req-4a106e53-5986-491f-9e8c-d809f0c85fd6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-657191cd-86e1-4e86-8d4a-465c0a18825b req-4a106e53-5986-491f-9e8c-d809f0c85fd6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-657191cd-86e1-4e86-8d4a-465c0a18825b req-4a106e53-5986-491f-9e8c-d809f0c85fd6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:58 user nova-compute[74534]: WARNING nova.compute.manager [req-657191cd-86e1-4e86-8d4a-465c0a18825b req-4a106e53-5986-491f-9e8c-d809f0c85fd6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b for instance with vm_state building and task_state spawning.
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-154de5c7-f0db-42c9-ada3-dd1d1fed5766 req-9606ecda-6249-410c-bd87-db00ab4e11f9 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-154de5c7-f0db-42c9-ada3-dd1d1fed5766 req-9606ecda-6249-410c-bd87-db00ab4e11f9 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-154de5c7-f0db-42c9-ada3-dd1d1fed5766 req-9606ecda-6249-410c-bd87-db00ab4e11f9 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-154de5c7-f0db-42c9-ada3-dd1d1fed5766 req-9606ecda-6249-410c-bd87-db00ab4e11f9 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-154de5c7-f0db-42c9-ada3-dd1d1fed5766 req-9606ecda-6249-410c-bd87-db00ab4e11f9 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:07:59 user nova-compute[74534]: WARNING nova.compute.manager [req-154de5c7-f0db-42c9-ada3-dd1d1fed5766 req-9606ecda-6249-410c-bd87-db00ab4e11f9 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 for instance with vm_state building and task_state spawning.
Nov 02 12:07:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Successfully updated port: 7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating instance_info_cache with network_info: [{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance network_info: |[{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:07:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:00 user nova-compute[74534]: WARNING nova.compute.manager [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 for instance with vm_state building and task_state spawning.
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-changed-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Refreshing instance network info cache due to event network-changed-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] Acquiring lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] Acquired lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.network.neutron [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Refreshing network info cache for port 7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:00 user nova-compute[74534]: WARNING nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b for instance with vm_state building and task_state spawning.
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:00 user nova-compute[74534]: WARNING nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 for instance with vm_state building and task_state spawning.
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:00 user nova-compute[74534]: WARNING nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 for instance with vm_state building and task_state spawning.
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:00 user nova-compute[74534]: WARNING nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 for instance with vm_state building and task_state spawning.
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:00 user nova-compute[74534]: WARNING nova.compute.manager [req-a56c086b-51c6-446b-ab66-66bd9bab3396 req-a4dfb523-3f80-4fd3-9d42-8dd3bd214572 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 for instance with vm_state building and task_state spawning.
Nov 02 12:08:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updated VIF entry in instance network info cache for port 7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating instance_info_cache with network_info: [{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43052e10-4b17-4dd7-ad87-feb16915ffef req-0690fb42-f02b-4579-8ef2-5e75bfd7477b service nova] Releasing lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:01 user nova-compute[74534]: WARNING nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 for instance with vm_state building and task_state spawning.
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:01 user nova-compute[74534]: WARNING nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 for instance with vm_state building and task_state spawning.
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:01 user nova-compute[74534]: WARNING nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 for instance with vm_state building and task_state spawning.
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:01 user nova-compute[74534]: WARNING nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b for instance with vm_state building and task_state spawning.
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:01 user nova-compute[74534]: WARNING nova.compute.manager [req-51cfcdf2-99a1-4f2f-b661-aa62f9d4ec8a req-ce9f5e1e-ca44-426e-aabd-4db474f1cb09 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b for instance with vm_state building and task_state spawning.
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:08:02 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance spawned successfully.
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:03 user nova-compute[74534]: INFO nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Took 12.31 seconds to spawn the instance on the hypervisor.
Nov 02 12:08:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:08:03 user nova-compute[74534]: INFO nova.compute.manager [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Took 78.68 seconds to build instance.
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9900270c-9f96-47c4-8c0d-e2262d36774e tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 78.769s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QETzUerP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:04 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:04 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:04 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a1fdc-08a4-4f8b-87ce-10515b9a80af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:08:05 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[accc0f67-4038-4658-af6d-5f94a09a9f4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf] added
Nov 02 12:08:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bae92b5-b093-4208-9a28-7cef9ca7cc5a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30a9460-d48b-4f22-8286-6ce76e92a35e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QETzUerP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QETzUerP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7843056-a835-4d76-ac70-29fddd33c517]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QETzUerP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef06c34d-6000-442f-87b2-4dfa5d408872]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711da06-ff24-49ef-9865-2f1a38d31778]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f0f91-dc24-4bea-aecb-941191febcaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260]
Nov 02 12:08:05 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260] successful.
Nov 02 12:08:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[47caa0b3-3e42-4822-b8c6-c46f6b39f1d8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b656d5-f482-4a69-83f4-7fa5e45d05ba]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:05 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7d2419-68f1-4bf2-ab2c-18160936567f]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QETzUerP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:08:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:08:05 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7171MB free_disk=25.369861602783203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 44fb7ed3-c943-42b2-8254-00aebe23d744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 60fef407-d916-4310-b722-465edfac927b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 46a22e79-d865-4998-954c-23dfc93f7608 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 20efc112-72c3-4d40-ae01-d1e827bc2fc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 0be2a397-b69d-46fc-a5c3-5f50f92a6781 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26262346263383836', 'path': '/dev/sdh'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262346263383836', 'path': '/dev/sdh'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'flavor' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:08:06 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:08:06 user nova-compute[74534]:   <source dev="/dev/sdh"/>
Nov 02 12:08:06 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:08:06 user nova-compute[74534]:   <serial>5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf</serial>
Nov 02 12:08:06 user nova-compute[74534]: </disk>
Nov 02 12:08:06 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.696s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No BDM found with device name hda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:08:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] No VIF found with MAC fa:16:3e:31:a9:8a, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:08:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d3f80cfb-4fc7-441b-b3f1-b0a485db794e tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.809s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:09 user nova-compute[74534]: INFO nova.compute.manager [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Detaching volume 5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf
Nov 02 12:08:09 user nova-compute[74534]: INFO nova.virt.block_device [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Attempting to driver detach volume 5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf from mountpoint /dev/vdb
Nov 02 12:08:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Attempting to detach device vdb from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:08:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:08:09 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:08:09 user nova-compute[74534]:   <source dev="/dev/sdh"/>
Nov 02 12:08:09 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:08:09 user nova-compute[74534]:   <serial>5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf</serial>
Nov 02 12:08:09 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 12:08:09 user nova-compute[74534]: </disk>
Nov 02 12:08:09 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:08:09 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully detached device vdb from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the persistent domain config.
Nov 02 12:08:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:08:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:08:09 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:08:09 user nova-compute[74534]:   <source dev="/dev/sdh"/>
Nov 02 12:08:09 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:08:09 user nova-compute[74534]:   <serial>5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf</serial>
Nov 02 12:08:09 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 12:08:09 user nova-compute[74534]: </disk>
Nov 02 12:08:09 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:08:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:08:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 44fb7ed3-c943-42b2-8254-00aebe23d744 is timed out.
Nov 02 12:08:12 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Successfully detached device sdc from instance 44fb7ed3-c943-42b2-8254-00aebe23d744 from the live domain config.
Nov 02 12:08:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQcBHmxu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:12 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1a314b-f269-47c8-9ab1-4b152137f565]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:08:12 user nova-compute[74534]: No targets found.
Nov 02 12:08:12 user nova-compute[74534]: iSNS:
Nov 02 12:08:12 user nova-compute[74534]: No targets found.
Nov 02 12:08:12 user nova-compute[74534]: STATIC:
Nov 02 12:08:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:08:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:08:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1
Nov 02 12:08:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:08:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf
Nov 02 12:08:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17
Nov 02 12:08:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84
Nov 02 12:08:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:12 user nova-compute[74534]: FIRMWARE:
Nov 02 12:08:12 user nova-compute[74534]: No targets found.
Nov 02 12:08:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:08:12 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:08:12 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b043b07-cc0d-4048-94fb-eecd6f49d1a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be69bd1-d659-41a6-b4e9-31e5a8e4210d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:12 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180349d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1'): ({'sdd'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Removing single pathed devices sdd {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d2253c-09f1-4362-bf10-dd6f5becad59]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0178f43-5a58-4032-90b4-5dba74b42c72]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Flushing IO for device /dev/sdd {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f96113-6aae-477b-8e09-dab12e1ded89]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFqTrRVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:12 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dd4314-0ae5-4303-b54d-a3ba4d84c7dd]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e138c3-e4a9-41b0-95ce-99719a96ee57]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e2ec2f-3598-492c-be36-280e49977691]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260]
Nov 02 12:08:13 user nova-compute[74534]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1, portal: 172.16.0.220,3260] successful.
Nov 02 12:08:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7e42b9-7d79-475f-823f-c535d74402e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a0ee16-1df4-467b-af26-c14de0f861df]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] <== disconnect_volume: return (354ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.192s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:13 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:13 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be1d9e-e037-499b-a064-a7b6cd3ccd7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:08:13 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6612c0-d344-4309-901b-15ee6a768593]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41] added
Nov 02 12:08:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4365bf-301b-43cd-aa10-bc4de3f6292c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe914c-2851-4f03-ba4e-131c8a3c6f54]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFqTrRVo {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFqTrRVo" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[819b963e-66cc-4fb3-a625-067487ec5fd1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFqTrRVo'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9227c99-d644-4325-abef-093826f8a561]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59304fae-a6af-429f-9c0d-9cff0e7a7800]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[356813d3-6a69-4bad-9237-171c1aca7197]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260]
Nov 02 12:08:13 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260] successful.
Nov 02 12:08:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb6785-2819-4864-bc93-0ebc5710214f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac57bdc1-ab54-4b07-95f2-4dd8901b6f44]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:13 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba51e2b-29e7-4d2b-ba09-21c7080e8ad8]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFqTrRVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.utils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aae82bf-e65e-4516-924e-0b87abe40e26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3da38-0984-4b1d-b7d1-81429351bdd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d21357d-665c-474c-aa26-bcb79b91d092]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb1e818-e7f5-4b7a-aa8f-f7f9693efff2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:08:13 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:08:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f679f03-aad9-4d97-a5ab-2d90903f6228]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG os_brick.utils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:13 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating existing volume attachment record: 1283d266-73f3-45c2-ac25-31241db01759 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lazy-loading 'flavor' on Instance uuid 44fb7ed3-c943-42b2-8254-00aebe23d744 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8c07063b-72f5-47b9-838c-0542d32e1e59 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.098s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] <== connect_volume: return (1579ms) {'type': 'block', 'scsi_wwn': '23364303439313634', 'path': '/dev/sdd'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364303439313634', 'path': '/dev/sdd'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lazy-loading 'flavor' on Instance uuid 60fef407-d916-4310-b722-465edfac927b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] attach device xml: <disk type="block" device="disk">
Nov 02 12:08:14 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:08:14 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:08:14 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:08:14 user nova-compute[74534]:   <serial>7d732031-5543-49fd-b0f3-11a8787f7e41</serial>
Nov 02 12:08:14 user nova-compute[74534]: </disk>
Nov 02 12:08:14 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:14 user nova-compute[74534]: INFO nova.compute.manager [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Terminating instance
Nov 02 12:08:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] No VIF found with MAC fa:16:3e:69:0d:e0, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4d798972-af55-4820-aabc-64683824abde tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "60fef407-d916-4310-b722-465edfac927b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.825s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-dc0f0481-c548-451f-b4a8-0bf75febff48 req-b0efca50-5364-4f52-9141-aabe2a748ba4 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-vif-unplugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dc0f0481-c548-451f-b4a8-0bf75febff48 req-b0efca50-5364-4f52-9141-aabe2a748ba4 service nova] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dc0f0481-c548-451f-b4a8-0bf75febff48 req-b0efca50-5364-4f52-9141-aabe2a748ba4 service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dc0f0481-c548-451f-b4a8-0bf75febff48 req-b0efca50-5364-4f52-9141-aabe2a748ba4 service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-dc0f0481-c548-451f-b4a8-0bf75febff48 req-b0efca50-5364-4f52-9141-aabe2a748ba4 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] No waiting events found dispatching network-vif-unplugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-dc0f0481-c548-451f-b4a8-0bf75febff48 req-b0efca50-5364-4f52-9141-aabe2a748ba4 service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-vif-unplugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] [instance: 60fef407-d916-4310-b722-465edfac927b] volume_snapshot_create: create_info: {'snapshot_id': 'a158fec9-efad-4c9d-ac0f-456a78aea982', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74534) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] [instance: 60fef407-d916-4310-b722-465edfac927b] snap xml: <domainsnapshot>
Nov 02 12:08:15 user nova-compute[74534]:   <disks>
Nov 02 12:08:15 user nova-compute[74534]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 02 12:08:15 user nova-compute[74534]:       <source file="/dev/new_file"/>
Nov 02 12:08:15 user nova-compute[74534]:     </disk>
Nov 02 12:08:15 user nova-compute[74534]:     <disk name="vda" snapshot="no"/>
Nov 02 12:08:15 user nova-compute[74534]:   </disks>
Nov 02 12:08:15 user nova-compute[74534]: </domainsnapshot>
Nov 02 12:08:15 user nova-compute[74534]:  {{(pid=74534) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] Lazy-loading 'system_metadata' on Instance uuid 60fef407-d916-4310-b722-465edfac927b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-766d744c-7166-43d8-a014-370f885bd45d tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] [instance: 60fef407-d916-4310-b722-465edfac927b] volume_snapshot_delete: delete_info: {'volume_id': '7d732031-5543-49fd-b0f3-11a8787f7e41'} {{(pid=74534) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [None req-766d744c-7166-43d8-a014-370f885bd45d tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] [instance: 60fef407-d916-4310-b722-465edfac927b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     if delete_info['type'] != 'qcow2':
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] KeyError: 'type'
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] 
Nov 02 12:08:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] [instance: 60fef407-d916-4310-b722-465edfac927b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] [instance: 60fef407-d916-4310-b722-465edfac927b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     rv = execute(f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     six.reraise(c, e, tb)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     raise value
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     rv = meth(*args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] [instance: 60fef407-d916-4310-b722-465edfac927b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     self._volume_snapshot_create(context, instance, guest,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     rv = execute(f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     six.reraise(c, e, tb)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     raise value
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     rv = meth(*args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [instance: 60fef407-d916-4310-b722-465edfac927b] 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [None req-766d744c-7166-43d8-a014-370f885bd45d tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-dbf805c1-0344-49c3-bd4e-04c06c0fdc91)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server [None req-766d744c-7166-43d8-a014-370f885bd45d tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] Exception during message handling: KeyError: 'type'
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a158fec9-efad-4c9d-ac0f-456a78aea982 could not be found.
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise value
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a158fec9-efad-4c9d-ac0f-456a78aea982 could not be found. (HTTP 404) (Request-ID: req-8a3cbe7a-5ce3-41b0-8aef-ab3b8d0ef713)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a158fec9-efad-4c9d-ac0f-456a78aea982 could not be found.
Nov 02 12:08:15 user nova-compute[74534]: ERROR nova.virt.libvirt.driver 
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server [None req-e0f817d1-b507-47de-ba41-ecd3ada5a34a tempest-VolumesAssistedSnapshotsTest-988344961 tempest-VolumesAssistedSnapshotsTest-988344961-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise value
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 12:08:15 user nova-compute[74534]: ERROR oslo_messaging.rpc.server 
Nov 02 12:08:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Instance destroyed successfully.
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lazy-loading 'resources' on Instance uuid 44fb7ed3-c943-42b2-8254-00aebe23d744 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-463582782',display_name='tempest-AttachSCSIVolumeTestJSON-server-463582782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-463582782',id=8,image_ref='832e42e5-b2b1-445b-a424-c003fb85d67e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG34ICnMQhvHFWKbFaeQuJFS8dBDov9Pb6iIeMYvcm53o4a6/a+8FrKgrJVEhUwD5ZBcyAY28Q6J8HEuxXsXrNfeh94lYUZUskYXoyuoezD+EtPKLhw20T5nq6ldS90ZsA==',key_name='tempest-keypair-1313123273',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6797852b38e8457e950bcf7674f2afb3',ramdisk_id='',reservation_id='r-9ndy5jyb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='832e42e5-b2b1-445b-a424-c003fb85d67e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-991220014',owner_user_name='tempest-AttachSCSIVolumeTestJSON-991220014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b846780942574a2e95e439402599b0b7',uuid=44fb7ed3-c943-42b2-8254-00aebe23d744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Converting VIF {"id": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "address": "fa:16:3e:a8:3c:b9", "network": {"id": "cfc2bf4b-8457-446a-8a46-b9f271884abf", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-668203316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6797852b38e8457e950bcf7674f2afb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape01ba90f-3c", "ovs_interfaceid": "e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3c:b9,bridge_name='br-int',has_traffic_filtering=True,id=e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3,network=Network(cfc2bf4b-8457-446a-8a46-b9f271884abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01ba90f-3c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG os_vif [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3c:b9,bridge_name='br-int',has_traffic_filtering=True,id=e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3,network=Network(cfc2bf4b-8457-446a-8a46-b9f271884abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01ba90f-3c') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape01ba90f-3c, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d99560c-577f-4529-948a-0bc89de9888a) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:15 user nova-compute[74534]: INFO os_vif [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3c:b9,bridge_name='br-int',has_traffic_filtering=True,id=e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3,network=Network(cfc2bf4b-8457-446a-8a46-b9f271884abf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape01ba90f-3c')
Nov 02 12:08:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Deleting instance files /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744_del
Nov 02 12:08:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Deletion of /opt/stack/data/nova/instances/44fb7ed3-c943-42b2-8254-00aebe23d744_del complete
Nov 02 12:08:16 user nova-compute[74534]: INFO nova.compute.manager [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 02 12:08:16 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:08:16 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:08:16 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:08:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Acquiring lock "60fef407-d916-4310-b722-465edfac927b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "60fef407-d916-4310-b722-465edfac927b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:16 user nova-compute[74534]: INFO nova.compute.manager [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] Detaching volume 7d732031-5543-49fd-b0f3-11a8787f7e41
Nov 02 12:08:16 user nova-compute[74534]: INFO nova.virt.block_device [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] Attempting to driver detach volume 7d732031-5543-49fd-b0f3-11a8787f7e41 from mountpoint /dev/vdb
Nov 02 12:08:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Attempting to detach device vdb from instance 60fef407-d916-4310-b722-465edfac927b from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:08:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 12:08:16 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:08:16 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:08:16 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:08:16 user nova-compute[74534]:   <serial>7d732031-5543-49fd-b0f3-11a8787f7e41</serial>
Nov 02 12:08:16 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:08:16 user nova-compute[74534]: </disk>
Nov 02 12:08:16 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:08:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Successfully detached device vdb from instance 60fef407-d916-4310-b722-465edfac927b from the persistent domain config.
Nov 02 12:08:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60fef407-d916-4310-b722-465edfac927b from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:08:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 12:08:16 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:08:16 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:08:16 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:08:16 user nova-compute[74534]:   <serial>7d732031-5543-49fd-b0f3-11a8787f7e41</serial>
Nov 02 12:08:16 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:08:16 user nova-compute[74534]: </disk>
Nov 02 12:08:16 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:08:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60fef407-d916-4310-b722-465edfac927b {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-3bb5b348-548e-4331-abdf-193645693db6 req-02e59d72-a79f-43f4-8c11-e870b708036f service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3bb5b348-548e-4331-abdf-193645693db6 req-02e59d72-a79f-43f4-8c11-e870b708036f service nova] Acquiring lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3bb5b348-548e-4331-abdf-193645693db6 req-02e59d72-a79f-43f4-8c11-e870b708036f service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3bb5b348-548e-4331-abdf-193645693db6 req-02e59d72-a79f-43f4-8c11-e870b708036f service nova] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-3bb5b348-548e-4331-abdf-193645693db6 req-02e59d72-a79f-43f4-8c11-e870b708036f service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] No waiting events found dispatching network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:17 user nova-compute[74534]: WARNING nova.compute.manager [req-3bb5b348-548e-4331-abdf-193645693db6 req-02e59d72-a79f-43f4-8c11-e870b708036f service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received unexpected event network-vif-plugged-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 for instance with vm_state active and task_state deleting.
Nov 02 12:08:17 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:17 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Took 1.34 seconds to deallocate network for instance.
Nov 02 12:08:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:08:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:17 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Deleted allocations for instance 44fb7ed3-c943-42b2-8254-00aebe23d744
Nov 02 12:08:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ba4f3d81-6e87-465f-81a6-a251b41adda9 tempest-AttachSCSIVolumeTestJSON-991220014 tempest-AttachSCSIVolumeTestJSON-991220014-project-member] Lock "44fb7ed3-c943-42b2-8254-00aebe23d744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.073s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-8aedbf71-eff3-4cac-983b-88bcef39bfb9 req-2a66606c-8eab-40de-a19a-c97a302a733b service nova] [instance: 44fb7ed3-c943-42b2-8254-00aebe23d744] Received event network-vif-deleted-e01ba90f-3cd4-4e1c-a1de-d85bfe22e1a3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 is timed out.
Nov 02 12:08:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully detached device vdb from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the live domain config.
Nov 02 12:08:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QETzUerP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:29 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a3e9b-289d-4fef-805d-3dedfb0ee37c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:08:29 user nova-compute[74534]: No targets found.
Nov 02 12:08:29 user nova-compute[74534]: iSNS:
Nov 02 12:08:29 user nova-compute[74534]: No targets found.
Nov 02 12:08:29 user nova-compute[74534]: STATIC:
Nov 02 12:08:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:08:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:08:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:08:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf
Nov 02 12:08:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41
Nov 02 12:08:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17
Nov 02 12:08:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84
Nov 02 12:08:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:29 user nova-compute[74534]: FIRMWARE:
Nov 02 12:08:29 user nova-compute[74534]: No targets found.
Nov 02 12:08:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:08:29 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:08:29 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2153206-7554-4045-b88a-de0c1e51e9a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7878199-3d7c-41ee-94ec-98ef43e4a9cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:29 user nova-compute[74534]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf (non-flash)
Nov 02 12:08:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180349a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf'): ({'sdh'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Removing single pathed devices sdh {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf5427-e5e1-4213-90fe-951fdfec9058]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc41a8c2-3536-4527-9ba7-6a7ddea3f218]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Flushing IO for device /dev/sdh {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ceeab-f006-4364-95e5-c647adc6730d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a31d78-9ec9-4b41-a7db-37630e9c4c27]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] SCSI volumes sdh have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf6342a-4419-4bf0-9f5c-8470ada960dc]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9685cb-fe7d-4946-8315-cfeb4ca717e2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260]
Nov 02 12:08:29 user nova-compute[74534]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf, portal: 172.16.0.220,3260] successful.
Nov 02 12:08:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb6b3e3-1cce-4bd2-9b70-6fa16eededcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bffdb6-cc9b-4be1-99bd-051a6cae81cb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] <== disconnect_volume: return (319ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:08:30 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'flavor' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d64d23ee-6ae1-4b2e-a58c-baf6dc1b768a tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.852s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "interface-33b75f56-25f3-42b9-a699-5cf4e3bf4f53-4a473cae-8dcf-49ab-9021-50d379fed620" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "interface-33b75f56-25f3-42b9-a699-5cf4e3bf4f53-4a473cae-8dcf-49ab-9021-50d379fed620" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.objects.instance [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'flavor' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converting VIF {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface> {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface> {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Attempting to detach device tap4a473cae-8d from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] detach device xml: <interface type="ethernet">
Nov 02 12:08:31 user nova-compute[74534]:   <mac address="fa:16:3e:d9:21:47"/>
Nov 02 12:08:31 user nova-compute[74534]:   <model type="virtio"/>
Nov 02 12:08:31 user nova-compute[74534]:   <mtu size="1442"/>
Nov 02 12:08:31 user nova-compute[74534]:   <target dev="tap4a473cae-8d"/>
Nov 02 12:08:31 user nova-compute[74534]: </interface>
Nov 02 12:08:31 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface> {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 12:08:31 user nova-compute[74534]:   <name>instance-00000009</name>
Nov 02 12:08:31 user nova-compute[74534]:   <uuid>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</uuid>
Nov 02 12:08:31 user nova-compute[74534]:   <metadata>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:31 user nova-compute[74534]:   <nova:package version="0.0.0"/>
Nov 02 12:08:31 user nova-compute[74534]:   <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:08:31 user nova-compute[74534]:   <nova:creationTime>2023-11-02 12:07:25</nova:creationTime>
Nov 02 12:08:31 user nova-compute[74534]:   <nova:flavor name="m1.tiny">
Nov 02 12:08:31 user nova-compute[74534]:     <nova:memory>512</nova:memory>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:disk>1</nova:disk>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:swap>0</nova:swap>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:31 user nova-compute[74534]:   </nova:flavor>
Nov 02 12:08:31 user nova-compute[74534]:   <nova:owner>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:08:31 user nova-compute[74534]:   </nova:owner>
Nov 02 12:08:31 user nova-compute[74534]:   <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:31 user nova-compute[74534]:   <nova:ports>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:08:31 user nova-compute[74534]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:08:31 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:31 user nova-compute[74534]:     <nova:port uuid="4a473cae-8dcf-49ab-9021-50d379fed620">
Nov 02 12:08:31 user nova-compute[74534]:       <nova:ip type="fixed" address="10.10.10.238" ipVersion="4"/>
Nov 02 12:08:31 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:31 user nova-compute[74534]:   </nova:ports>
Nov 02 12:08:31 user nova-compute[74534]: </nova:instance>
Nov 02 12:08:31 user nova-compute[74534]:   </metadata>
Nov 02 12:08:31 user nova-compute[74534]:   <memory unit='KiB'>524288</memory>
Nov 02 12:08:31 user nova-compute[74534]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 12:08:31 user nova-compute[74534]:   <vcpu placement='static'>1</vcpu>
Nov 02 12:08:31 user nova-compute[74534]:   <resource>
Nov 02 12:08:31 user nova-compute[74534]:     <partition>/machine</partition>
Nov 02 12:08:31 user nova-compute[74534]:   </resource>
Nov 02 12:08:31 user nova-compute[74534]:   <sysinfo type='smbios'>
Nov 02 12:08:31 user nova-compute[74534]:     <system>
Nov 02 12:08:31 user nova-compute[74534]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 12:08:31 user nova-compute[74534]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 12:08:31 user nova-compute[74534]:       <entry name='version'>0.0.0</entry>
Nov 02 12:08:31 user nova-compute[74534]:       <entry name='serial'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:31 user nova-compute[74534]:       <entry name='uuid'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:31 user nova-compute[74534]:       <entry name='family'>Virtual Machine</entry>
Nov 02 12:08:31 user nova-compute[74534]:     </system>
Nov 02 12:08:31 user nova-compute[74534]:   </sysinfo>
Nov 02 12:08:31 user nova-compute[74534]:   <os>
Nov 02 12:08:31 user nova-compute[74534]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 12:08:31 user nova-compute[74534]:     <boot dev='hd'/>
Nov 02 12:08:31 user nova-compute[74534]:     <smbios mode='sysinfo'/>
Nov 02 12:08:31 user nova-compute[74534]:   </os>
Nov 02 12:08:31 user nova-compute[74534]:   <features>
Nov 02 12:08:31 user nova-compute[74534]:     <acpi/>
Nov 02 12:08:31 user nova-compute[74534]:     <apic/>
Nov 02 12:08:31 user nova-compute[74534]:     <vmcoreinfo state='on'/>
Nov 02 12:08:31 user nova-compute[74534]:   </features>
Nov 02 12:08:31 user nova-compute[74534]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 12:08:31 user nova-compute[74534]:     <model fallback='forbid'>Nehalem</model>
Nov 02 12:08:31 user nova-compute[74534]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 12:08:31 user nova-compute[74534]:     <feature policy='require' name='vme'/>
Nov 02 12:08:31 user nova-compute[74534]:     <feature policy='require' name='x2apic'/>
Nov 02 12:08:31 user nova-compute[74534]:     <feature policy='require' name='hypervisor'/>
Nov 02 12:08:31 user nova-compute[74534]:   </cpu>
Nov 02 12:08:31 user nova-compute[74534]:   <clock offset='utc'>
Nov 02 12:08:31 user nova-compute[74534]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 12:08:31 user nova-compute[74534]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 12:08:31 user nova-compute[74534]:     <timer name='hpet' present='no'/>
Nov 02 12:08:31 user nova-compute[74534]:   </clock>
Nov 02 12:08:31 user nova-compute[74534]:   <on_poweroff>destroy</on_poweroff>
Nov 02 12:08:31 user nova-compute[74534]:   <on_reboot>restart</on_reboot>
Nov 02 12:08:31 user nova-compute[74534]:   <on_crash>destroy</on_crash>
Nov 02 12:08:31 user nova-compute[74534]:   <devices>
Nov 02 12:08:31 user nova-compute[74534]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 12:08:31 user nova-compute[74534]:     <disk type='file' device='disk'>
Nov 02 12:08:31 user nova-compute[74534]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 12:08:31 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk' index='2'/>
Nov 02 12:08:31 user nova-compute[74534]:       <backingStore type='file' index='3'>
Nov 02 12:08:31 user nova-compute[74534]:         <format type='raw'/>
Nov 02 12:08:31 user nova-compute[74534]:         <source file='/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe'/>
Nov 02 12:08:31 user nova-compute[74534]:         <backingStore/>
Nov 02 12:08:31 user nova-compute[74534]:       </backingStore>
Nov 02 12:08:31 user nova-compute[74534]:       <target dev='vda' bus='virtio'/>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='virtio-disk0'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </disk>
Nov 02 12:08:31 user nova-compute[74534]:     <disk type='file' device='cdrom'>
Nov 02 12:08:31 user nova-compute[74534]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 12:08:31 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config' index='1'/>
Nov 02 12:08:31 user nova-compute[74534]:       <backingStore/>
Nov 02 12:08:31 user nova-compute[74534]:       <target dev='hda' bus='ide'/>
Nov 02 12:08:31 user nova-compute[74534]:       <readonly/>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='ide0-0-0'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </disk>
Nov 02 12:08:31 user nova-compute[74534]:     <controller type='usb' index='0' model='none'>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='usb'/>
Nov 02 12:08:31 user nova-compute[74534]:     </controller>
Nov 02 12:08:31 user nova-compute[74534]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='pci.0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </controller>
Nov 02 12:08:31 user nova-compute[74534]:     <controller type='ide' index='0'>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='ide'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 12:08:31 user nova-compute[74534]:     </controller>
Nov 02 12:08:31 user nova-compute[74534]:     <interface type='ethernet'>
Nov 02 12:08:31 user nova-compute[74534]:       <mac address='fa:16:3e:31:a9:8a'/>
Nov 02 12:08:31 user nova-compute[74534]:       <target dev='tap8e801a89-2f'/>
Nov 02 12:08:31 user nova-compute[74534]:       <model type='virtio'/>
Nov 02 12:08:31 user nova-compute[74534]:       <mtu size='1442'/>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='net0'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </interface>
Nov 02 12:08:31 user nova-compute[74534]:     <interface type='ethernet'>
Nov 02 12:08:31 user nova-compute[74534]:       <mac address='fa:16:3e:d9:21:47'/>
Nov 02 12:08:31 user nova-compute[74534]:       <target dev='tap4a473cae-8d'/>
Nov 02 12:08:31 user nova-compute[74534]:       <model type='virtio'/>
Nov 02 12:08:31 user nova-compute[74534]:       <mtu size='1442'/>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='net1'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </interface>
Nov 02 12:08:31 user nova-compute[74534]:     <serial type='pty'>
Nov 02 12:08:31 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:31 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:31 user nova-compute[74534]:       <target type='isa-serial' port='0'>
Nov 02 12:08:31 user nova-compute[74534]:         <model name='isa-serial'/>
Nov 02 12:08:31 user nova-compute[74534]:       </target>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </serial>
Nov 02 12:08:31 user nova-compute[74534]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 12:08:31 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:31 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:31 user nova-compute[74534]:       <target type='serial' port='0'/>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </console>
Nov 02 12:08:31 user nova-compute[74534]:     <input type='mouse' bus='ps2'>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='input0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </input>
Nov 02 12:08:31 user nova-compute[74534]:     <input type='keyboard' bus='ps2'>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='input1'/>
Nov 02 12:08:31 user nova-compute[74534]:     </input>
Nov 02 12:08:31 user nova-compute[74534]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 12:08:31 user nova-compute[74534]:       <listen type='address' address='0.0.0.0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </graphics>
Nov 02 12:08:31 user nova-compute[74534]:     <audio id='1' type='none'/>
Nov 02 12:08:31 user nova-compute[74534]:     <video>
Nov 02 12:08:31 user nova-compute[74534]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='video0'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </video>
Nov 02 12:08:31 user nova-compute[74534]:     <memballoon model='virtio'>
Nov 02 12:08:31 user nova-compute[74534]:       <stats period='10'/>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='balloon0'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </memballoon>
Nov 02 12:08:31 user nova-compute[74534]:     <rng model='virtio'>
Nov 02 12:08:31 user nova-compute[74534]:       <backend model='random'>/dev/urandom</backend>
Nov 02 12:08:31 user nova-compute[74534]:       <alias name='rng0'/>
Nov 02 12:08:31 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 12:08:31 user nova-compute[74534]:     </rng>
Nov 02 12:08:31 user nova-compute[74534]:   </devices>
Nov 02 12:08:31 user nova-compute[74534]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 12:08:31 user nova-compute[74534]:     <label>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</label>
Nov 02 12:08:31 user nova-compute[74534]:     <imagelabel>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</imagelabel>
Nov 02 12:08:31 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:31 user nova-compute[74534]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 12:08:31 user nova-compute[74534]:     <label>+64055:+108</label>
Nov 02 12:08:31 user nova-compute[74534]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 12:08:31 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:31 user nova-compute[74534]: </domain>
Nov 02 12:08:31 user nova-compute[74534]:  {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 12:08:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully detached device tap4a473cae-8d from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the persistent domain config.
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] (1/8): Attempting to detach device tap4a473cae-8d with device alias net1 from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] detach device xml: <interface type="ethernet">
Nov 02 12:08:31 user nova-compute[74534]:   <mac address="fa:16:3e:d9:21:47"/>
Nov 02 12:08:31 user nova-compute[74534]:   <model type="virtio"/>
Nov 02 12:08:31 user nova-compute[74534]:   <mtu size="1442"/>
Nov 02 12:08:31 user nova-compute[74534]:   <target dev="tap4a473cae-8d"/>
Nov 02 12:08:31 user nova-compute[74534]: </interface>
Nov 02 12:08:31 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Start waiting for the detach event from libvirt for device tap4a473cae-8d with device alias net1 for instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-b50dde6a-fdeb-4d84-bc43-9c1dec8af7cc req-ddc2a843-d400-4afb-9b8b-8b17beb6b637 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-unplugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b50dde6a-fdeb-4d84-bc43-9c1dec8af7cc req-ddc2a843-d400-4afb-9b8b-8b17beb6b637 service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b50dde6a-fdeb-4d84-bc43-9c1dec8af7cc req-ddc2a843-d400-4afb-9b8b-8b17beb6b637 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b50dde6a-fdeb-4d84-bc43-9c1dec8af7cc req-ddc2a843-d400-4afb-9b8b-8b17beb6b637 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-b50dde6a-fdeb-4d84-bc43-9c1dec8af7cc req-ddc2a843-d400-4afb-9b8b-8b17beb6b637 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-unplugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:31 user nova-compute[74534]: WARNING nova.compute.manager [req-b50dde6a-fdeb-4d84-bc43-9c1dec8af7cc req-ddc2a843-d400-4afb-9b8b-8b17beb6b637 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received unexpected event network-vif-unplugged-4a473cae-8dcf-49ab-9021-50d379fed620 for instance with vm_state active and task_state None.
Nov 02 12:08:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-6235b8d2-eb47-4f9d-9dd7-bd0fe0b59c74 req-f9444a92-59e2-4dae-bacd-ff1e88d8baa6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6235b8d2-eb47-4f9d-9dd7-bd0fe0b59c74 req-f9444a92-59e2-4dae-bacd-ff1e88d8baa6 service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6235b8d2-eb47-4f9d-9dd7-bd0fe0b59c74 req-f9444a92-59e2-4dae-bacd-ff1e88d8baa6 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6235b8d2-eb47-4f9d-9dd7-bd0fe0b59c74 req-f9444a92-59e2-4dae-bacd-ff1e88d8baa6 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-6235b8d2-eb47-4f9d-9dd7-bd0fe0b59c74 req-f9444a92-59e2-4dae-bacd-ff1e88d8baa6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:33 user nova-compute[74534]: WARNING nova.compute.manager [req-6235b8d2-eb47-4f9d-9dd7-bd0fe0b59c74 req-f9444a92-59e2-4dae-bacd-ff1e88d8baa6 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received unexpected event network-vif-plugged-4a473cae-8dcf-49ab-9021-50d379fed620 for instance with vm_state active and task_state None.
Nov 02 12:08:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:36 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60fef407-d916-4310-b722-465edfac927b is timed out.
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "46a22e79-d865-4998-954c-23dfc93f7608" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "46a22e79-d865-4998-954c-23dfc93f7608" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "46a22e79-d865-4998-954c-23dfc93f7608-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:36 user nova-compute[74534]: INFO nova.compute.manager [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Terminating instance
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:08:36 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Successfully detached device vdb from instance 60fef407-d916-4310-b722-465edfac927b from the live domain config.
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFqTrRVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:36 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1982428-b4a7-45a1-b9e5-639f987c7145]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:08:36 user nova-compute[74534]: No targets found.
Nov 02 12:08:36 user nova-compute[74534]: iSNS:
Nov 02 12:08:36 user nova-compute[74534]: No targets found.
Nov 02 12:08:36 user nova-compute[74534]: STATIC:
Nov 02 12:08:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:08:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:08:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:08:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41
Nov 02 12:08:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17
Nov 02 12:08:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84
Nov 02 12:08:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:08:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:08:36 user nova-compute[74534]: FIRMWARE:
Nov 02 12:08:36 user nova-compute[74534]: No targets found.
Nov 02 12:08:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:08:36 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:08:36 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa2aa0-0dda-45ac-b07e-df98c6a7d46d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5579fc9e-5690-4165-970c-6d7da4f0c511]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:36 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180425a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41'): ({'sdd'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Removing single pathed devices sdd {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[06462767-c91c-4883-a63a-ff89fa44a34e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fefbb78-3f1f-42e8-8d9f-0a46a56bd09b]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Flushing IO for device /dev/sdd {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:08:36 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Creating image(s)
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Ensure instance console log exists: /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Start _get_guest_xml network_info=[{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': '1283d266-73f3-45c2-ac25-31241db01759', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeNhFBDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45b47223-abde-4927-8ad3-1389fed70985', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7b84838-380c-4c07-860b-c1c4229c9dd6', 'serial': 'c7b84838-380c-4c07-860b-c1c4229c9dd6'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c5a4f-3248-474b-9a6a-08477bafbbbd]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:36 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:08:36 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeNhFBDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:36 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ca257-9c27-4e4b-9e58-b1ddf5f76df3]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:08:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e6272-2fe3-4af8-9b58-0a7ac905b7f0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94b40b-901f-4bbf-b189-6124fb540afa]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260]
Nov 02 12:08:37 user nova-compute[74534]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41, portal: 172.16.0.220,3260] successful.
Nov 02 12:08:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-d75298aa-7714-4f28-ae02-2c28c874be74 req-b016aa31-b46e-479d-980d-7a1f9d658ad1 service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received event network-vif-unplugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d75298aa-7714-4f28-ae02-2c28c874be74 req-b016aa31-b46e-479d-980d-7a1f9d658ad1 service nova] Acquiring lock "46a22e79-d865-4998-954c-23dfc93f7608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d75298aa-7714-4f28-ae02-2c28c874be74 req-b016aa31-b46e-479d-980d-7a1f9d658ad1 service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d75298aa-7714-4f28-ae02-2c28c874be74 req-b016aa31-b46e-479d-980d-7a1f9d658ad1 service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-d75298aa-7714-4f28-ae02-2c28c874be74 req-b016aa31-b46e-479d-980d-7a1f9d658ad1 service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] No waiting events found dispatching network-vif-unplugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-d75298aa-7714-4f28-ae02-2c28c874be74 req-b016aa31-b46e-479d-980d-7a1f9d658ad1 service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received event network-vif-unplugged-3103ad5c-f9a6-4336-bf6c-56547d621afa for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d732031-5543-49fd-b0f3-11a8787f7e41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b88c22-b595-4d1b-871f-294d848ba108]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] <== disconnect_volume: return (438ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] [instance: 60fef407-d916-4310-b722-465edfac927b] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.163s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:37 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:08:37 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472ba7c-fb97-4aa0-8a79-f3be9fab1ce3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:08:37 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cab5554-2c9e-4321-bbba-8ea3f5097349]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6] added
Nov 02 12:08:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[965a1bcb-5bdb-4e91-b6c9-5ecd83b5c29b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8933f4-128a-4d04-ace2-bd1be9642937]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeNhFBDq {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeNhFBDq" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db27c85-2a78-4e07-9653-e1c8e70fdabf]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HeNhFBDq'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6946e6-e913-48f3-9e0f-8587871bbf6b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32f336-4a4b-4d8b-9f33-5742c5439678]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[470f6406-cb4c-405b-8c9d-f3c687dc3ffb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260]
Nov 02 12:08:37 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260] successful.
Nov 02 12:08:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f08bb0-2403-4a45-ad19-9e2d652bda46]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Instance destroyed successfully.
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lazy-loading 'resources' on Instance uuid 46a22e79-d865-4998-954c-23dfc93f7608 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1429109745',display_name='tempest-VolumesActionsTest-instance-1429109745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1429109745',id=11,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:06:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c632d2880cae4fee92c4b408c9c2aff5',ramdisk_id='',reservation_id='r-e1o0kxd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-105983395',owner_user_name='tempest-VolumesActionsTest-105983395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:06:33Z,user_data=None,user_id='b9b5a220e5284d76b8a1ee606a2104fb',uuid=46a22e79-d865-4998-954c-23dfc93f7608,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converting VIF {"id": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "address": "fa:16:3e:80:5f:6a", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3103ad5c-f9", "ovs_interfaceid": "3103ad5c-f9a6-4336-bf6c-56547d621afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=3103ad5c-f9a6-4336-bf6c-56547d621afa,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3103ad5c-f9') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_vif [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=3103ad5c-f9a6-4336-bf6c-56547d621afa,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3103ad5c-f9') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd2bfa-f408-4e0b-bf67-5a423f507f1c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:08:37 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:08:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3103ad5c-f9, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4256e704-a7d1-4d40-a75f-b85eb68467e4]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeNhFBDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81b84ef4-269e-4f4e-a418-bd17475dab9a) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:37 user nova-compute[74534]: INFO os_vif [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:5f:6a,bridge_name='br-int',has_traffic_filtering=True,id=3103ad5c-f9a6-4336-bf6c-56547d621afa,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3103ad5c-f9')
Nov 02 12:08:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Deleting instance files /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608_del
Nov 02 12:08:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Deletion of /opt/stack/data/nova/instances/46a22e79-d865-4998-954c-23dfc93f7608_del complete
Nov 02 12:08:37 user nova-compute[74534]: INFO nova.compute.manager [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 02 12:08:37 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:08:37 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lazy-loading 'flavor' on Instance uuid 60fef407-d916-4310-b722-465edfac927b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:38 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Took 0.48 seconds to deallocate network for instance.
Nov 02 12:08:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f75fa047-176b-4e55-b842-3d7aab014fb3 tempest-VolumesAssistedSnapshotsTest-332357800 tempest-VolumesAssistedSnapshotsTest-332357800-project-admin] Lock "60fef407-d916-4310-b722-465edfac927b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== connect_volume: return (1560ms) {'type': 'block', 'scsi_wwn': '26461313130303834', 'path': '/dev/sdd'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461313130303834', 'path': '/dev/sdd'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322581251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322581251',id=14,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-dg7alpnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:07:58Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=45b47223-abde-4927-8ad3-1389fed70985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'pci_devices' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:08:38 user nova-compute[74534]:   <uuid>45b47223-abde-4927-8ad3-1389fed70985</uuid>
Nov 02 12:08:38 user nova-compute[74534]:   <name>instance-0000000e</name>
Nov 02 12:08:38 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:08:38 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:08:38 user nova-compute[74534]:   <metadata>
Nov 02 12:08:38 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:38 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:08:38 user nova-compute[74534]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1322581251</nova:name>
Nov 02 12:08:38 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:08:36</nova:creationTime>
Nov 02 12:08:38 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:08:38 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:08:38 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:08:38 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:08:38 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:38 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:38 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:08:38 user nova-compute[74534]:       <nova:owner>
Nov 02 12:08:38 user nova-compute[74534]:         <nova:user uuid="caf5cde0e75e444da00c7bcda4bcdd28">tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member</nova:user>
Nov 02 12:08:38 user nova-compute[74534]:         <nova:project uuid="25ccb20fcd184ecebd3707d9d93c8817">tempest-ServerBootFromVolumeStableRescueTest-1363504210</nova:project>
Nov 02 12:08:38 user nova-compute[74534]:       </nova:owner>
Nov 02 12:08:38 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:38 user nova-compute[74534]:       <nova:ports>
Nov 02 12:08:38 user nova-compute[74534]:         <nova:port uuid="7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5">
Nov 02 12:08:38 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 12:08:38 user nova-compute[74534]:         </nova:port>
Nov 02 12:08:38 user nova-compute[74534]:       </nova:ports>
Nov 02 12:08:38 user nova-compute[74534]:     </nova:instance>
Nov 02 12:08:38 user nova-compute[74534]:   </metadata>
Nov 02 12:08:38 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:08:38 user nova-compute[74534]:     <system>
Nov 02 12:08:38 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:08:38 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:08:38 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:08:38 user nova-compute[74534]:       <entry name="serial">45b47223-abde-4927-8ad3-1389fed70985</entry>
Nov 02 12:08:38 user nova-compute[74534]:       <entry name="uuid">45b47223-abde-4927-8ad3-1389fed70985</entry>
Nov 02 12:08:38 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:08:38 user nova-compute[74534]:     </system>
Nov 02 12:08:38 user nova-compute[74534]:   </sysinfo>
Nov 02 12:08:38 user nova-compute[74534]:   <os>
Nov 02 12:08:38 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:08:38 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:08:38 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:08:38 user nova-compute[74534]:   </os>
Nov 02 12:08:38 user nova-compute[74534]:   <features>
Nov 02 12:08:38 user nova-compute[74534]:     <acpi/>
Nov 02 12:08:38 user nova-compute[74534]:     <apic/>
Nov 02 12:08:38 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:08:38 user nova-compute[74534]:   </features>
Nov 02 12:08:38 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:08:38 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:08:38 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:08:38 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:08:38 user nova-compute[74534]:   </clock>
Nov 02 12:08:38 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:08:38 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:08:38 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:08:38 user nova-compute[74534]:   </cpu>
Nov 02 12:08:38 user nova-compute[74534]:   <devices>
Nov 02 12:08:38 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:08:38 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:08:38 user nova-compute[74534]:       <source dev="/dev/sdd"/>
Nov 02 12:08:38 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:08:38 user nova-compute[74534]:       <serial>c7b84838-380c-4c07-860b-c1c4229c9dd6</serial>
Nov 02 12:08:38 user nova-compute[74534]:     </disk>
Nov 02 12:08:38 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:08:38 user nova-compute[74534]:       <mac address="fa:16:3e:8c:d2:d9"/>
Nov 02 12:08:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:08:38 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:08:38 user nova-compute[74534]:       <target dev="tap7dc3f134-1a"/>
Nov 02 12:08:38 user nova-compute[74534]:     </interface>
Nov 02 12:08:38 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:08:38 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/console.log" append="off"/>
Nov 02 12:08:38 user nova-compute[74534]:     </serial>
Nov 02 12:08:38 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:08:38 user nova-compute[74534]:     <video>
Nov 02 12:08:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:08:38 user nova-compute[74534]:     </video>
Nov 02 12:08:38 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:08:38 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:08:38 user nova-compute[74534]:     </rng>
Nov 02 12:08:38 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:08:38 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:08:38 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:08:38 user nova-compute[74534]:     </memballoon>
Nov 02 12:08:38 user nova-compute[74534]:   </devices>
Nov 02 12:08:38 user nova-compute[74534]: </domain>
Nov 02 12:08:38 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322581251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322581251',id=14,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-dg7alpnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:07:58Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=45b47223-abde-4927-8ad3-1389fed70985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG os_vif [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71150a29-fc80-56ec-a387-20b0149b71f3', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:38 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Deleted allocations for instance 46a22e79-d865-4998-954c-23dfc93f7608
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dc3f134-1a, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dc3f134-1a, col_values=(('qos', UUID('a3072b1e-f00d-4719-a0b9-cccb857856f9')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dc3f134-1a, col_values=(('external_ids', {'iface-id': '7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:d2:d9', 'vm-uuid': '45b47223-abde-4927-8ad3-1389fed70985'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:38 user nova-compute[74534]: INFO os_vif [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a')
Nov 02 12:08:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08ab90ec-b68a-4a7b-b926-93127b45ed74 tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "46a22e79-d865-4998-954c-23dfc93f7608" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.058s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:08:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No VIF found with MAC fa:16:3e:8c:d2:d9, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:08:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-1bcd07b6-f59c-4502-84e4-a13577eee098 req-ee82301b-fdcd-4f82-be83-676026b5db3d service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received event network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1bcd07b6-f59c-4502-84e4-a13577eee098 req-ee82301b-fdcd-4f82-be83-676026b5db3d service nova] Acquiring lock "46a22e79-d865-4998-954c-23dfc93f7608-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1bcd07b6-f59c-4502-84e4-a13577eee098 req-ee82301b-fdcd-4f82-be83-676026b5db3d service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1bcd07b6-f59c-4502-84e4-a13577eee098 req-ee82301b-fdcd-4f82-be83-676026b5db3d service nova] Lock "46a22e79-d865-4998-954c-23dfc93f7608-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-1bcd07b6-f59c-4502-84e4-a13577eee098 req-ee82301b-fdcd-4f82-be83-676026b5db3d service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] No waiting events found dispatching network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:39 user nova-compute[74534]: WARNING nova.compute.manager [req-1bcd07b6-f59c-4502-84e4-a13577eee098 req-ee82301b-fdcd-4f82-be83-676026b5db3d service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received unexpected event network-vif-plugged-3103ad5c-f9a6-4336-bf6c-56547d621afa for instance with vm_state deleted and task_state None.
Nov 02 12:08:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-1bcd07b6-f59c-4502-84e4-a13577eee098 req-ee82301b-fdcd-4f82-be83-676026b5db3d service nova] [instance: 46a22e79-d865-4998-954c-23dfc93f7608] Received event network-vif-deleted-3103ad5c-f9a6-4336-bf6c-56547d621afa {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-0a7cf846-265a-4be1-b704-983283372d91 req-9152d5c4-efaf-4387-a540-0420adc5f697 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0a7cf846-265a-4be1-b704-983283372d91 req-9152d5c4-efaf-4387-a540-0420adc5f697 service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0a7cf846-265a-4be1-b704-983283372d91 req-9152d5c4-efaf-4387-a540-0420adc5f697 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0a7cf846-265a-4be1-b704-983283372d91 req-9152d5c4-efaf-4387-a540-0420adc5f697 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-0a7cf846-265a-4be1-b704-983283372d91 req-9152d5c4-efaf-4387-a540-0420adc5f697 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:40 user nova-compute[74534]: WARNING nova.compute.manager [req-0a7cf846-265a-4be1-b704-983283372d91 req-9152d5c4-efaf-4387-a540-0420adc5f697 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state building and task_state spawning.
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:08:42 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance spawned successfully.
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:42 user nova-compute[74534]: INFO nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:08:42 user nova-compute[74534]: INFO nova.compute.manager [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Took 45.48 seconds to build instance.
Nov 02 12:08:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2c76eb2b-8c6a-4bb1-8257-36fbada6766e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "45b47223-abde-4927-8ad3-1389fed70985" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.584s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-75e590b9-37e1-4023-8431-e918181a748a req-fba85e51-13cd-4fc9-bfbb-b8868b2c574b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75e590b9-37e1-4023-8431-e918181a748a req-fba85e51-13cd-4fc9-bfbb-b8868b2c574b service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75e590b9-37e1-4023-8431-e918181a748a req-fba85e51-13cd-4fc9-bfbb-b8868b2c574b service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75e590b9-37e1-4023-8431-e918181a748a req-fba85e51-13cd-4fc9-bfbb-b8868b2c574b service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-75e590b9-37e1-4023-8431-e918181a748a req-fba85e51-13cd-4fc9-bfbb-b8868b2c574b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:42 user nova-compute[74534]: WARNING nova.compute.manager [req-75e590b9-37e1-4023-8431-e918181a748a req-fba85e51-13cd-4fc9-bfbb-b8868b2c574b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state active and task_state None.
Nov 02 12:08:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.objects.instance [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'flavor' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:51 user nova-compute[74534]: INFO nova.compute.manager [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Attaching volume 58ba8952-292f-4352-9cdf-ecaec6db2af2 to /dev/vdb
Nov 02 12:08:51 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Waiting for libvirt event about the detach of device tap4a473cae-8d with device alias net1 from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 is timed out.
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface> {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 12:08:51 user nova-compute[74534]:   <name>instance-00000009</name>
Nov 02 12:08:51 user nova-compute[74534]:   <uuid>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</uuid>
Nov 02 12:08:51 user nova-compute[74534]:   <metadata>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:51 user nova-compute[74534]:   <nova:package version="0.0.0"/>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:creationTime>2023-11-02 12:07:25</nova:creationTime>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:flavor name="m1.tiny">
Nov 02 12:08:51 user nova-compute[74534]:     <nova:memory>512</nova:memory>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:disk>1</nova:disk>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:swap>0</nova:swap>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:51 user nova-compute[74534]:   </nova:flavor>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:owner>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:08:51 user nova-compute[74534]:   </nova:owner>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:ports>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:08:51 user nova-compute[74534]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:08:51 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:port uuid="4a473cae-8dcf-49ab-9021-50d379fed620">
Nov 02 12:08:51 user nova-compute[74534]:       <nova:ip type="fixed" address="10.10.10.238" ipVersion="4"/>
Nov 02 12:08:51 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:51 user nova-compute[74534]:   </nova:ports>
Nov 02 12:08:51 user nova-compute[74534]: </nova:instance>
Nov 02 12:08:51 user nova-compute[74534]:   </metadata>
Nov 02 12:08:51 user nova-compute[74534]:   <memory unit='KiB'>524288</memory>
Nov 02 12:08:51 user nova-compute[74534]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 12:08:51 user nova-compute[74534]:   <vcpu placement='static'>1</vcpu>
Nov 02 12:08:51 user nova-compute[74534]:   <resource>
Nov 02 12:08:51 user nova-compute[74534]:     <partition>/machine</partition>
Nov 02 12:08:51 user nova-compute[74534]:   </resource>
Nov 02 12:08:51 user nova-compute[74534]:   <sysinfo type='smbios'>
Nov 02 12:08:51 user nova-compute[74534]:     <system>
Nov 02 12:08:51 user nova-compute[74534]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 12:08:51 user nova-compute[74534]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 12:08:51 user nova-compute[74534]:       <entry name='version'>0.0.0</entry>
Nov 02 12:08:51 user nova-compute[74534]:       <entry name='serial'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:51 user nova-compute[74534]:       <entry name='uuid'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:51 user nova-compute[74534]:       <entry name='family'>Virtual Machine</entry>
Nov 02 12:08:51 user nova-compute[74534]:     </system>
Nov 02 12:08:51 user nova-compute[74534]:   </sysinfo>
Nov 02 12:08:51 user nova-compute[74534]:   <os>
Nov 02 12:08:51 user nova-compute[74534]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 12:08:51 user nova-compute[74534]:     <boot dev='hd'/>
Nov 02 12:08:51 user nova-compute[74534]:     <smbios mode='sysinfo'/>
Nov 02 12:08:51 user nova-compute[74534]:   </os>
Nov 02 12:08:51 user nova-compute[74534]:   <features>
Nov 02 12:08:51 user nova-compute[74534]:     <acpi/>
Nov 02 12:08:51 user nova-compute[74534]:     <apic/>
Nov 02 12:08:51 user nova-compute[74534]:     <vmcoreinfo state='on'/>
Nov 02 12:08:51 user nova-compute[74534]:   </features>
Nov 02 12:08:51 user nova-compute[74534]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 12:08:51 user nova-compute[74534]:     <model fallback='forbid'>Nehalem</model>
Nov 02 12:08:51 user nova-compute[74534]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 12:08:51 user nova-compute[74534]:     <feature policy='require' name='vme'/>
Nov 02 12:08:51 user nova-compute[74534]:     <feature policy='require' name='x2apic'/>
Nov 02 12:08:51 user nova-compute[74534]:     <feature policy='require' name='hypervisor'/>
Nov 02 12:08:51 user nova-compute[74534]:   </cpu>
Nov 02 12:08:51 user nova-compute[74534]:   <clock offset='utc'>
Nov 02 12:08:51 user nova-compute[74534]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 12:08:51 user nova-compute[74534]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 12:08:51 user nova-compute[74534]:     <timer name='hpet' present='no'/>
Nov 02 12:08:51 user nova-compute[74534]:   </clock>
Nov 02 12:08:51 user nova-compute[74534]:   <on_poweroff>destroy</on_poweroff>
Nov 02 12:08:51 user nova-compute[74534]:   <on_reboot>restart</on_reboot>
Nov 02 12:08:51 user nova-compute[74534]:   <on_crash>destroy</on_crash>
Nov 02 12:08:51 user nova-compute[74534]:   <devices>
Nov 02 12:08:51 user nova-compute[74534]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 12:08:51 user nova-compute[74534]:     <disk type='file' device='disk'>
Nov 02 12:08:51 user nova-compute[74534]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 12:08:51 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk' index='2'/>
Nov 02 12:08:51 user nova-compute[74534]:       <backingStore type='file' index='3'>
Nov 02 12:08:51 user nova-compute[74534]:         <format type='raw'/>
Nov 02 12:08:51 user nova-compute[74534]:         <source file='/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe'/>
Nov 02 12:08:51 user nova-compute[74534]:         <backingStore/>
Nov 02 12:08:51 user nova-compute[74534]:       </backingStore>
Nov 02 12:08:51 user nova-compute[74534]:       <target dev='vda' bus='virtio'/>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='virtio-disk0'/>
Nov 02 12:08:51 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </disk>
Nov 02 12:08:51 user nova-compute[74534]:     <disk type='file' device='cdrom'>
Nov 02 12:08:51 user nova-compute[74534]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 12:08:51 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config' index='1'/>
Nov 02 12:08:51 user nova-compute[74534]:       <backingStore/>
Nov 02 12:08:51 user nova-compute[74534]:       <target dev='hda' bus='ide'/>
Nov 02 12:08:51 user nova-compute[74534]:       <readonly/>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='ide0-0-0'/>
Nov 02 12:08:51 user nova-compute[74534]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </disk>
Nov 02 12:08:51 user nova-compute[74534]:     <controller type='usb' index='0' model='none'>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='usb'/>
Nov 02 12:08:51 user nova-compute[74534]:     </controller>
Nov 02 12:08:51 user nova-compute[74534]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='pci.0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </controller>
Nov 02 12:08:51 user nova-compute[74534]:     <controller type='ide' index='0'>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='ide'/>
Nov 02 12:08:51 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 12:08:51 user nova-compute[74534]:     </controller>
Nov 02 12:08:51 user nova-compute[74534]:     <interface type='ethernet'>
Nov 02 12:08:51 user nova-compute[74534]:       <mac address='fa:16:3e:31:a9:8a'/>
Nov 02 12:08:51 user nova-compute[74534]:       <target dev='tap8e801a89-2f'/>
Nov 02 12:08:51 user nova-compute[74534]:       <model type='virtio'/>
Nov 02 12:08:51 user nova-compute[74534]:       <mtu size='1442'/>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='net0'/>
Nov 02 12:08:51 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </interface>
Nov 02 12:08:51 user nova-compute[74534]:     <serial type='pty'>
Nov 02 12:08:51 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:51 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:51 user nova-compute[74534]:       <target type='isa-serial' port='0'>
Nov 02 12:08:51 user nova-compute[74534]:         <model name='isa-serial'/>
Nov 02 12:08:51 user nova-compute[74534]:       </target>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </serial>
Nov 02 12:08:51 user nova-compute[74534]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 12:08:51 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:51 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:51 user nova-compute[74534]:       <target type='serial' port='0'/>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </console>
Nov 02 12:08:51 user nova-compute[74534]:     <input type='mouse' bus='ps2'>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='input0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </input>
Nov 02 12:08:51 user nova-compute[74534]:     <input type='keyboard' bus='ps2'>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='input1'/>
Nov 02 12:08:51 user nova-compute[74534]:     </input>
Nov 02 12:08:51 user nova-compute[74534]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 12:08:51 user nova-compute[74534]:       <listen type='address' address='0.0.0.0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </graphics>
Nov 02 12:08:51 user nova-compute[74534]:     <audio id='1' type='none'/>
Nov 02 12:08:51 user nova-compute[74534]:     <video>
Nov 02 12:08:51 user nova-compute[74534]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='video0'/>
Nov 02 12:08:51 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </video>
Nov 02 12:08:51 user nova-compute[74534]:     <memballoon model='virtio'>
Nov 02 12:08:51 user nova-compute[74534]:       <stats period='10'/>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='balloon0'/>
Nov 02 12:08:51 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </memballoon>
Nov 02 12:08:51 user nova-compute[74534]:     <rng model='virtio'>
Nov 02 12:08:51 user nova-compute[74534]:       <backend model='random'>/dev/urandom</backend>
Nov 02 12:08:51 user nova-compute[74534]:       <alias name='rng0'/>
Nov 02 12:08:51 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 12:08:51 user nova-compute[74534]:     </rng>
Nov 02 12:08:51 user nova-compute[74534]:   </devices>
Nov 02 12:08:51 user nova-compute[74534]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 12:08:51 user nova-compute[74534]:     <label>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</label>
Nov 02 12:08:51 user nova-compute[74534]:     <imagelabel>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</imagelabel>
Nov 02 12:08:51 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:51 user nova-compute[74534]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 12:08:51 user nova-compute[74534]:     <label>+64055:+108</label>
Nov 02 12:08:51 user nova-compute[74534]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 12:08:51 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:51 user nova-compute[74534]: </domain>
Nov 02 12:08:51 user nova-compute[74534]:  {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 12:08:51 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully detached device tap4a473cae-8d from instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 from the live domain config.
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converting VIF {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG os_vif [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a473cae-8d, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG os_brick.utils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df778a80-9e56-40b2-83ac-125cf1503d44) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac56e32a-9466-4304-8b96-db3536b9caf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:51 user nova-compute[74534]: INFO os_vif [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d')
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:51 user nova-compute[74534]:   <nova:package version="0.0.0"/>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:creationTime>2023-11-02 12:08:51</nova:creationTime>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:flavor name="m1.tiny">
Nov 02 12:08:51 user nova-compute[74534]:     <nova:memory>512</nova:memory>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:disk>1</nova:disk>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:swap>0</nova:swap>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:51 user nova-compute[74534]:   </nova:flavor>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:owner>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:08:51 user nova-compute[74534]:   </nova:owner>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:51 user nova-compute[74534]:   <nova:ports>
Nov 02 12:08:51 user nova-compute[74534]:     <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:08:51 user nova-compute[74534]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:08:51 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:51 user nova-compute[74534]:   </nova:ports>
Nov 02 12:08:51 user nova-compute[74534]: </nova:instance>
Nov 02 12:08:51 user nova-compute[74534]:  {{(pid=74534) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59a7fa-33df-4518-89c5-014f66d21bb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[563e888b-2413-4dbc-8e21-826b9150c75a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fb2357-d975-49a2-ba62-f83e95a8451d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:08:51 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae56d47-ddbc-4dc6-a549-67074d153579]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG os_brick.utils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating existing volume attachment record: cc6e7af8-d8a7-4b0e-a929-3e3eb0744e3f {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:51 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:08:51 user nova-compute[74534]: INFO nova.compute.claims [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Claim successful on node user
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-deleted-4a473cae-8dcf-49ab-9021-50d379fed620 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:52 user nova-compute[74534]: INFO nova.compute.manager [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Neutron deleted interface 4a473cae-8dcf-49ab-9021-50d379fed620; detaching it from the instance and deleting it from the info cache
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.network.neutron [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquired lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.objects.instance [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Lazy-loading 'system_metadata' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.objects.instance [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Lazy-loading 'flavor' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.objects.base [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Object Instance<33b75f56-25f3-42b9-a699-5cf4e3bf4f53> lazy-loaded attributes: system_metadata,flavor {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Converting VIF {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface> {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 12:08:52 user nova-compute[74534]:   <name>instance-00000009</name>
Nov 02 12:08:52 user nova-compute[74534]:   <uuid>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</uuid>
Nov 02 12:08:52 user nova-compute[74534]:   <metadata>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:52 user nova-compute[74534]:   <nova:package version="0.0.0"/>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:creationTime>2023-11-02 12:08:51</nova:creationTime>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:flavor name="m1.tiny">
Nov 02 12:08:52 user nova-compute[74534]:     <nova:memory>512</nova:memory>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:disk>1</nova:disk>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:swap>0</nova:swap>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:flavor>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:owner>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:owner>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:ports>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:08:52 user nova-compute[74534]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:08:52 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:ports>
Nov 02 12:08:52 user nova-compute[74534]: </nova:instance>
Nov 02 12:08:52 user nova-compute[74534]:   </metadata>
Nov 02 12:08:52 user nova-compute[74534]:   <memory unit='KiB'>524288</memory>
Nov 02 12:08:52 user nova-compute[74534]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 12:08:52 user nova-compute[74534]:   <vcpu placement='static'>1</vcpu>
Nov 02 12:08:52 user nova-compute[74534]:   <resource>
Nov 02 12:08:52 user nova-compute[74534]:     <partition>/machine</partition>
Nov 02 12:08:52 user nova-compute[74534]:   </resource>
Nov 02 12:08:52 user nova-compute[74534]:   <sysinfo type='smbios'>
Nov 02 12:08:52 user nova-compute[74534]:     <system>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='version'>0.0.0</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='serial'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='uuid'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='family'>Virtual Machine</entry>
Nov 02 12:08:52 user nova-compute[74534]:     </system>
Nov 02 12:08:52 user nova-compute[74534]:   </sysinfo>
Nov 02 12:08:52 user nova-compute[74534]:   <os>
Nov 02 12:08:52 user nova-compute[74534]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 12:08:52 user nova-compute[74534]:     <boot dev='hd'/>
Nov 02 12:08:52 user nova-compute[74534]:     <smbios mode='sysinfo'/>
Nov 02 12:08:52 user nova-compute[74534]:   </os>
Nov 02 12:08:52 user nova-compute[74534]:   <features>
Nov 02 12:08:52 user nova-compute[74534]:     <acpi/>
Nov 02 12:08:52 user nova-compute[74534]:     <apic/>
Nov 02 12:08:52 user nova-compute[74534]:     <vmcoreinfo state='on'/>
Nov 02 12:08:52 user nova-compute[74534]:   </features>
Nov 02 12:08:52 user nova-compute[74534]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 12:08:52 user nova-compute[74534]:     <model fallback='forbid'>Nehalem</model>
Nov 02 12:08:52 user nova-compute[74534]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 12:08:52 user nova-compute[74534]:     <feature policy='require' name='vme'/>
Nov 02 12:08:52 user nova-compute[74534]:     <feature policy='require' name='x2apic'/>
Nov 02 12:08:52 user nova-compute[74534]:     <feature policy='require' name='hypervisor'/>
Nov 02 12:08:52 user nova-compute[74534]:   </cpu>
Nov 02 12:08:52 user nova-compute[74534]:   <clock offset='utc'>
Nov 02 12:08:52 user nova-compute[74534]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 12:08:52 user nova-compute[74534]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 12:08:52 user nova-compute[74534]:     <timer name='hpet' present='no'/>
Nov 02 12:08:52 user nova-compute[74534]:   </clock>
Nov 02 12:08:52 user nova-compute[74534]:   <on_poweroff>destroy</on_poweroff>
Nov 02 12:08:52 user nova-compute[74534]:   <on_reboot>restart</on_reboot>
Nov 02 12:08:52 user nova-compute[74534]:   <on_crash>destroy</on_crash>
Nov 02 12:08:52 user nova-compute[74534]:   <devices>
Nov 02 12:08:52 user nova-compute[74534]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 12:08:52 user nova-compute[74534]:     <disk type='file' device='disk'>
Nov 02 12:08:52 user nova-compute[74534]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 12:08:52 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk' index='2'/>
Nov 02 12:08:52 user nova-compute[74534]:       <backingStore type='file' index='3'>
Nov 02 12:08:52 user nova-compute[74534]:         <format type='raw'/>
Nov 02 12:08:52 user nova-compute[74534]:         <source file='/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe'/>
Nov 02 12:08:52 user nova-compute[74534]:         <backingStore/>
Nov 02 12:08:52 user nova-compute[74534]:       </backingStore>
Nov 02 12:08:52 user nova-compute[74534]:       <target dev='vda' bus='virtio'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='virtio-disk0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </disk>
Nov 02 12:08:52 user nova-compute[74534]:     <disk type='file' device='cdrom'>
Nov 02 12:08:52 user nova-compute[74534]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 12:08:52 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config' index='1'/>
Nov 02 12:08:52 user nova-compute[74534]:       <backingStore/>
Nov 02 12:08:52 user nova-compute[74534]:       <target dev='hda' bus='ide'/>
Nov 02 12:08:52 user nova-compute[74534]:       <readonly/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='ide0-0-0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </disk>
Nov 02 12:08:52 user nova-compute[74534]:     <controller type='usb' index='0' model='none'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='usb'/>
Nov 02 12:08:52 user nova-compute[74534]:     </controller>
Nov 02 12:08:52 user nova-compute[74534]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='pci.0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </controller>
Nov 02 12:08:52 user nova-compute[74534]:     <controller type='ide' index='0'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='ide'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 12:08:52 user nova-compute[74534]:     </controller>
Nov 02 12:08:52 user nova-compute[74534]:     <interface type='ethernet'>
Nov 02 12:08:52 user nova-compute[74534]:       <mac address='fa:16:3e:31:a9:8a'/>
Nov 02 12:08:52 user nova-compute[74534]:       <target dev='tap8e801a89-2f'/>
Nov 02 12:08:52 user nova-compute[74534]:       <model type='virtio'/>
Nov 02 12:08:52 user nova-compute[74534]:       <mtu size='1442'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='net0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </interface>
Nov 02 12:08:52 user nova-compute[74534]:     <serial type='pty'>
Nov 02 12:08:52 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:52 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:52 user nova-compute[74534]:       <target type='isa-serial' port='0'>
Nov 02 12:08:52 user nova-compute[74534]:         <model name='isa-serial'/>
Nov 02 12:08:52 user nova-compute[74534]:       </target>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </serial>
Nov 02 12:08:52 user nova-compute[74534]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 12:08:52 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:52 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:52 user nova-compute[74534]:       <target type='serial' port='0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </console>
Nov 02 12:08:52 user nova-compute[74534]:     <input type='mouse' bus='ps2'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='input0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </input>
Nov 02 12:08:52 user nova-compute[74534]:     <input type='keyboard' bus='ps2'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='input1'/>
Nov 02 12:08:52 user nova-compute[74534]:     </input>
Nov 02 12:08:52 user nova-compute[74534]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 12:08:52 user nova-compute[74534]:       <listen type='address' address='0.0.0.0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </graphics>
Nov 02 12:08:52 user nova-compute[74534]:     <audio id='1' type='none'/>
Nov 02 12:08:52 user nova-compute[74534]:     <video>
Nov 02 12:08:52 user nova-compute[74534]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='video0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </video>
Nov 02 12:08:52 user nova-compute[74534]:     <memballoon model='virtio'>
Nov 02 12:08:52 user nova-compute[74534]:       <stats period='10'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='balloon0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </memballoon>
Nov 02 12:08:52 user nova-compute[74534]:     <rng model='virtio'>
Nov 02 12:08:52 user nova-compute[74534]:       <backend model='random'>/dev/urandom</backend>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='rng0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </rng>
Nov 02 12:08:52 user nova-compute[74534]:   </devices>
Nov 02 12:08:52 user nova-compute[74534]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 12:08:52 user nova-compute[74534]:     <label>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</label>
Nov 02 12:08:52 user nova-compute[74534]:     <imagelabel>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</imagelabel>
Nov 02 12:08:52 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:52 user nova-compute[74534]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 12:08:52 user nova-compute[74534]:     <label>+64055:+108</label>
Nov 02 12:08:52 user nova-compute[74534]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 12:08:52 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:52 user nova-compute[74534]: </domain>
Nov 02 12:08:52 user nova-compute[74534]:  {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface> {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:21:47"/><model type="virtio"/><mtu size="1442"/><target dev="tap4a473cae-8d"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 02 12:08:52 user nova-compute[74534]:   <name>instance-00000009</name>
Nov 02 12:08:52 user nova-compute[74534]:   <uuid>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</uuid>
Nov 02 12:08:52 user nova-compute[74534]:   <metadata>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:52 user nova-compute[74534]:   <nova:package version="0.0.0"/>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:creationTime>2023-11-02 12:08:51</nova:creationTime>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:flavor name="m1.tiny">
Nov 02 12:08:52 user nova-compute[74534]:     <nova:memory>512</nova:memory>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:disk>1</nova:disk>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:swap>0</nova:swap>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:flavor>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:owner>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:owner>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:ports>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:08:52 user nova-compute[74534]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:08:52 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:ports>
Nov 02 12:08:52 user nova-compute[74534]: </nova:instance>
Nov 02 12:08:52 user nova-compute[74534]:   </metadata>
Nov 02 12:08:52 user nova-compute[74534]:   <memory unit='KiB'>524288</memory>
Nov 02 12:08:52 user nova-compute[74534]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 12:08:52 user nova-compute[74534]:   <vcpu placement='static'>1</vcpu>
Nov 02 12:08:52 user nova-compute[74534]:   <resource>
Nov 02 12:08:52 user nova-compute[74534]:     <partition>/machine</partition>
Nov 02 12:08:52 user nova-compute[74534]:   </resource>
Nov 02 12:08:52 user nova-compute[74534]:   <sysinfo type='smbios'>
Nov 02 12:08:52 user nova-compute[74534]:     <system>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='version'>0.0.0</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='serial'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='uuid'>33b75f56-25f3-42b9-a699-5cf4e3bf4f53</entry>
Nov 02 12:08:52 user nova-compute[74534]:       <entry name='family'>Virtual Machine</entry>
Nov 02 12:08:52 user nova-compute[74534]:     </system>
Nov 02 12:08:52 user nova-compute[74534]:   </sysinfo>
Nov 02 12:08:52 user nova-compute[74534]:   <os>
Nov 02 12:08:52 user nova-compute[74534]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 12:08:52 user nova-compute[74534]:     <boot dev='hd'/>
Nov 02 12:08:52 user nova-compute[74534]:     <smbios mode='sysinfo'/>
Nov 02 12:08:52 user nova-compute[74534]:   </os>
Nov 02 12:08:52 user nova-compute[74534]:   <features>
Nov 02 12:08:52 user nova-compute[74534]:     <acpi/>
Nov 02 12:08:52 user nova-compute[74534]:     <apic/>
Nov 02 12:08:52 user nova-compute[74534]:     <vmcoreinfo state='on'/>
Nov 02 12:08:52 user nova-compute[74534]:   </features>
Nov 02 12:08:52 user nova-compute[74534]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 12:08:52 user nova-compute[74534]:     <model fallback='forbid'>Nehalem</model>
Nov 02 12:08:52 user nova-compute[74534]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 12:08:52 user nova-compute[74534]:     <feature policy='require' name='vme'/>
Nov 02 12:08:52 user nova-compute[74534]:     <feature policy='require' name='x2apic'/>
Nov 02 12:08:52 user nova-compute[74534]:     <feature policy='require' name='hypervisor'/>
Nov 02 12:08:52 user nova-compute[74534]:   </cpu>
Nov 02 12:08:52 user nova-compute[74534]:   <clock offset='utc'>
Nov 02 12:08:52 user nova-compute[74534]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 12:08:52 user nova-compute[74534]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 12:08:52 user nova-compute[74534]:     <timer name='hpet' present='no'/>
Nov 02 12:08:52 user nova-compute[74534]:   </clock>
Nov 02 12:08:52 user nova-compute[74534]:   <on_poweroff>destroy</on_poweroff>
Nov 02 12:08:52 user nova-compute[74534]:   <on_reboot>restart</on_reboot>
Nov 02 12:08:52 user nova-compute[74534]:   <on_crash>destroy</on_crash>
Nov 02 12:08:52 user nova-compute[74534]:   <devices>
Nov 02 12:08:52 user nova-compute[74534]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 12:08:52 user nova-compute[74534]:     <disk type='file' device='disk'>
Nov 02 12:08:52 user nova-compute[74534]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 12:08:52 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk' index='2'/>
Nov 02 12:08:52 user nova-compute[74534]:       <backingStore type='file' index='3'>
Nov 02 12:08:52 user nova-compute[74534]:         <format type='raw'/>
Nov 02 12:08:52 user nova-compute[74534]:         <source file='/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe'/>
Nov 02 12:08:52 user nova-compute[74534]:         <backingStore/>
Nov 02 12:08:52 user nova-compute[74534]:       </backingStore>
Nov 02 12:08:52 user nova-compute[74534]:       <target dev='vda' bus='virtio'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='virtio-disk0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </disk>
Nov 02 12:08:52 user nova-compute[74534]:     <disk type='file' device='cdrom'>
Nov 02 12:08:52 user nova-compute[74534]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 12:08:52 user nova-compute[74534]:       <source file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk.config' index='1'/>
Nov 02 12:08:52 user nova-compute[74534]:       <backingStore/>
Nov 02 12:08:52 user nova-compute[74534]:       <target dev='hda' bus='ide'/>
Nov 02 12:08:52 user nova-compute[74534]:       <readonly/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='ide0-0-0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </disk>
Nov 02 12:08:52 user nova-compute[74534]:     <controller type='usb' index='0' model='none'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='usb'/>
Nov 02 12:08:52 user nova-compute[74534]:     </controller>
Nov 02 12:08:52 user nova-compute[74534]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='pci.0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </controller>
Nov 02 12:08:52 user nova-compute[74534]:     <controller type='ide' index='0'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='ide'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 12:08:52 user nova-compute[74534]:     </controller>
Nov 02 12:08:52 user nova-compute[74534]:     <interface type='ethernet'>
Nov 02 12:08:52 user nova-compute[74534]:       <mac address='fa:16:3e:31:a9:8a'/>
Nov 02 12:08:52 user nova-compute[74534]:       <target dev='tap8e801a89-2f'/>
Nov 02 12:08:52 user nova-compute[74534]:       <model type='virtio'/>
Nov 02 12:08:52 user nova-compute[74534]:       <mtu size='1442'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='net0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </interface>
Nov 02 12:08:52 user nova-compute[74534]:     <serial type='pty'>
Nov 02 12:08:52 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:52 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:52 user nova-compute[74534]:       <target type='isa-serial' port='0'>
Nov 02 12:08:52 user nova-compute[74534]:         <model name='isa-serial'/>
Nov 02 12:08:52 user nova-compute[74534]:       </target>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </serial>
Nov 02 12:08:52 user nova-compute[74534]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 12:08:52 user nova-compute[74534]:       <source path='/dev/pts/8'/>
Nov 02 12:08:52 user nova-compute[74534]:       <log file='/opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/console.log' append='off'/>
Nov 02 12:08:52 user nova-compute[74534]:       <target type='serial' port='0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='serial0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </console>
Nov 02 12:08:52 user nova-compute[74534]:     <input type='mouse' bus='ps2'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='input0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </input>
Nov 02 12:08:52 user nova-compute[74534]:     <input type='keyboard' bus='ps2'>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='input1'/>
Nov 02 12:08:52 user nova-compute[74534]:     </input>
Nov 02 12:08:52 user nova-compute[74534]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 02 12:08:52 user nova-compute[74534]:       <listen type='address' address='0.0.0.0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </graphics>
Nov 02 12:08:52 user nova-compute[74534]:     <audio id='1' type='none'/>
Nov 02 12:08:52 user nova-compute[74534]:     <video>
Nov 02 12:08:52 user nova-compute[74534]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='video0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </video>
Nov 02 12:08:52 user nova-compute[74534]:     <memballoon model='virtio'>
Nov 02 12:08:52 user nova-compute[74534]:       <stats period='10'/>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='balloon0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </memballoon>
Nov 02 12:08:52 user nova-compute[74534]:     <rng model='virtio'>
Nov 02 12:08:52 user nova-compute[74534]:       <backend model='random'>/dev/urandom</backend>
Nov 02 12:08:52 user nova-compute[74534]:       <alias name='rng0'/>
Nov 02 12:08:52 user nova-compute[74534]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 12:08:52 user nova-compute[74534]:     </rng>
Nov 02 12:08:52 user nova-compute[74534]:   </devices>
Nov 02 12:08:52 user nova-compute[74534]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 12:08:52 user nova-compute[74534]:     <label>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</label>
Nov 02 12:08:52 user nova-compute[74534]:     <imagelabel>libvirt-33b75f56-25f3-42b9-a699-5cf4e3bf4f53</imagelabel>
Nov 02 12:08:52 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:52 user nova-compute[74534]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 12:08:52 user nova-compute[74534]:     <label>+64055:+108</label>
Nov 02 12:08:52 user nova-compute[74534]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 12:08:52 user nova-compute[74534]:   </seclabel>
Nov 02 12:08:52 user nova-compute[74534]: </domain>
Nov 02 12:08:52 user nova-compute[74534]:  {{(pid=74534) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 12:08:52 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Detaching interface fa:16:3e:d9:21:47 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4a473cae-8d' not found.
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Converting VIF {"id": "4a473cae-8dcf-49ab-9021-50d379fed620", "address": "fa:16:3e:d9:21:47", "network": {"id": "04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-697696381", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a473cae-8d", "ovs_interfaceid": "4a473cae-8dcf-49ab-9021-50d379fed620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG os_vif [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:08:52 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:08:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a473cae-8d, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:08:52 user nova-compute[74534]: INFO os_vif [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:21:47,bridge_name='br-int',has_traffic_filtering=True,id=4a473cae-8dcf-49ab-9021-50d379fed620,network=Network(04a2e3d5-6ddf-4ce8-9689-d74f29f4bf18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a473cae-8d')
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [req-ba9ee4f9-8fc8-4ae5-9070-7ddb437b83ae req-0972ea9d-dd7f-474d-bad2-abfdae9a5f94 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:52 user nova-compute[74534]:   <nova:package version="0.0.0"/>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:name>tempest-device-tagging-server-1100608694</nova:name>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:creationTime>2023-11-02 12:08:52</nova:creationTime>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:flavor name="m1.tiny">
Nov 02 12:08:52 user nova-compute[74534]:     <nova:memory>512</nova:memory>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:disk>1</nova:disk>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:swap>0</nova:swap>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:flavor>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:owner>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:user uuid="90050c453aad4f63b4a7615a0ff0f560">tempest-TaggedAttachmentsTest-997566028-project-member</nova:user>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:project uuid="f3c15ccf99034cb9bdc6ca3e19c1ac29">tempest-TaggedAttachmentsTest-997566028</nova:project>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:owner>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:52 user nova-compute[74534]:   <nova:ports>
Nov 02 12:08:52 user nova-compute[74534]:     <nova:port uuid="8e801a89-2f1c-41ef-85c2-67e6ed38ce9c">
Nov 02 12:08:52 user nova-compute[74534]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:08:52 user nova-compute[74534]:     </nova:port>
Nov 02 12:08:52 user nova-compute[74534]:   </nova:ports>
Nov 02 12:08:52 user nova-compute[74534]: </nova:instance>
Nov 02 12:08:52 user nova-compute[74534]:  {{(pid=74534) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lazy-loading 'flavor' on Instance uuid 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:08:52 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Creating image(s)
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG nova.policy [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec72fd62d437457ba42756f1da97516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f787c9b1e8154b4da75ac5299c888706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:52 user nova-compute[74534]: INFO nova.compute.manager [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Attaching volume 6decd5c3-0e06-47f4-990f-3dc007ec3d7a to /dev/vdb
Nov 02 12:08:52 user nova-compute[74534]: DEBUG os_brick.utils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fb5767-d7b6-4b65-89e8-5c211d336f60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc713d66-6f13-4ef3-95c2-6011a41476cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[863aaeca-63c1-45fb-bcfb-edc93278e038]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk 1073741824" returned: 0 in 0.059s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f6813e-1ea9-40a5-95a1-9b4640c170a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:53 user nova-compute[74534]: INFO nova.network.neutron [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Port 4a473cae-8dcf-49ab-9021-50d379fed620 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 02 12:08:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [{"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:08:53 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c40162-65a5-4a39-854b-613b6da5965e]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG os_brick.utils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating existing volume attachment record: 410892c4-b288-4a14-b10f-89fefc145061 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Releasing lock "refresh_cache-33b75f56-25f3-42b9-a699-5cf4e3bf4f53" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f96e8f8e-65e7-4896-b061-e062f6411d86 tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "interface-33b75f56-25f3-42b9-a699-5cf4e3bf4f53-4a473cae-8dcf-49ab-9021-50d379fed620" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.116s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Cannot resize image /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Ensure instance console log exists: /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:53 user nova-compute[74534]: DEBUG nova.network.neutron [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Successfully created port: df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.neutron [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Successfully updated port: df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquired lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.neutron [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-changed-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Refreshing instance network info cache due to event network-changed-df1e966f-35ba-4e1e-b92b-e35ba3d79b61. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] Acquiring lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.neutron [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.neutron [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updating instance_info_cache with network_info: [{"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Releasing lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance network_info: |[{"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] Acquired lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.neutron [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Refreshing network info cache for port df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Start _get_guest_xml network_info=[{"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:08:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:08:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-494432744',display_name='tempest-tempest.common.compute-instance-494432744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-494432744',id=15,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0Er+iV0JuqGua4bxljSzid6e+SBjxx22nRQ+h73MhbqL5/talrrpwV6bPTgkxz82FgRzDTXzhYgQCd6uha9SECrsSRu7T8feWG69VkQgQbXnJ9BhWbbsv4PIJhs9P1cg==',key_name='tempest-keypair-2079383095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-g4t4y7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=530fbde9-c0cf-4f20-9b7c-b91296394e2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.objects.instance [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'pci_devices' on Instance uuid 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:08:54 user nova-compute[74534]:   <uuid>530fbde9-c0cf-4f20-9b7c-b91296394e2e</uuid>
Nov 02 12:08:54 user nova-compute[74534]:   <name>instance-0000000f</name>
Nov 02 12:08:54 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:08:54 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:08:54 user nova-compute[74534]:   <metadata>
Nov 02 12:08:54 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:08:54 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:08:54 user nova-compute[74534]:       <nova:name>tempest-tempest.common.compute-instance-494432744</nova:name>
Nov 02 12:08:54 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:08:54</nova:creationTime>
Nov 02 12:08:54 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:08:54 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:08:54 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:08:54 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:08:54 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:08:54 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:08:54 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:08:54 user nova-compute[74534]:       <nova:owner>
Nov 02 12:08:54 user nova-compute[74534]:         <nova:user uuid="ec72fd62d437457ba42756f1da97516c">tempest-ServerActionsTestOtherA-500741581-project-member</nova:user>
Nov 02 12:08:54 user nova-compute[74534]:         <nova:project uuid="f787c9b1e8154b4da75ac5299c888706">tempest-ServerActionsTestOtherA-500741581</nova:project>
Nov 02 12:08:54 user nova-compute[74534]:       </nova:owner>
Nov 02 12:08:54 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:08:54 user nova-compute[74534]:       <nova:ports>
Nov 02 12:08:54 user nova-compute[74534]:         <nova:port uuid="df1e966f-35ba-4e1e-b92b-e35ba3d79b61">
Nov 02 12:08:54 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 12:08:54 user nova-compute[74534]:         </nova:port>
Nov 02 12:08:54 user nova-compute[74534]:       </nova:ports>
Nov 02 12:08:54 user nova-compute[74534]:     </nova:instance>
Nov 02 12:08:54 user nova-compute[74534]:   </metadata>
Nov 02 12:08:54 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:08:54 user nova-compute[74534]:     <system>
Nov 02 12:08:54 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:08:54 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:08:54 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:08:54 user nova-compute[74534]:       <entry name="serial">530fbde9-c0cf-4f20-9b7c-b91296394e2e</entry>
Nov 02 12:08:54 user nova-compute[74534]:       <entry name="uuid">530fbde9-c0cf-4f20-9b7c-b91296394e2e</entry>
Nov 02 12:08:54 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:08:54 user nova-compute[74534]:     </system>
Nov 02 12:08:54 user nova-compute[74534]:   </sysinfo>
Nov 02 12:08:54 user nova-compute[74534]:   <os>
Nov 02 12:08:54 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:08:54 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:08:54 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:08:54 user nova-compute[74534]:   </os>
Nov 02 12:08:54 user nova-compute[74534]:   <features>
Nov 02 12:08:54 user nova-compute[74534]:     <acpi/>
Nov 02 12:08:54 user nova-compute[74534]:     <apic/>
Nov 02 12:08:54 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:08:54 user nova-compute[74534]:   </features>
Nov 02 12:08:54 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:08:54 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:08:54 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:08:54 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:08:54 user nova-compute[74534]:   </clock>
Nov 02 12:08:54 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:08:54 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:08:54 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:08:54 user nova-compute[74534]:   </cpu>
Nov 02 12:08:54 user nova-compute[74534]:   <devices>
Nov 02 12:08:54 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:08:54 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:08:54 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk"/>
Nov 02 12:08:54 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:08:54 user nova-compute[74534]:     </disk>
Nov 02 12:08:54 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:08:54 user nova-compute[74534]:       <mac address="fa:16:3e:b9:fb:c9"/>
Nov 02 12:08:54 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:08:54 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:08:54 user nova-compute[74534]:       <target dev="tapdf1e966f-35"/>
Nov 02 12:08:54 user nova-compute[74534]:     </interface>
Nov 02 12:08:54 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:08:54 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/console.log" append="off"/>
Nov 02 12:08:54 user nova-compute[74534]:     </serial>
Nov 02 12:08:54 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:08:54 user nova-compute[74534]:     <video>
Nov 02 12:08:54 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:08:54 user nova-compute[74534]:     </video>
Nov 02 12:08:54 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:08:54 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:08:54 user nova-compute[74534]:     </rng>
Nov 02 12:08:54 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:08:54 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:08:54 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:08:54 user nova-compute[74534]:     </memballoon>
Nov 02 12:08:54 user nova-compute[74534]:   </devices>
Nov 02 12:08:54 user nova-compute[74534]: </domain>
Nov 02 12:08:54 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-494432744',display_name='tempest-tempest.common.compute-instance-494432744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-494432744',id=15,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0Er+iV0JuqGua4bxljSzid6e+SBjxx22nRQ+h73MhbqL5/talrrpwV6bPTgkxz82FgRzDTXzhYgQCd6uha9SECrsSRu7T8feWG69VkQgQbXnJ9BhWbbsv4PIJhs9P1cg==',key_name='tempest-keypair-2079383095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-g4t4y7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=530fbde9-c0cf-4f20-9b7c-b91296394e2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG os_vif [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10f3da87-371d-560b-81f7-071e2e1c954b', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf1e966f-35, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf1e966f-35, col_values=(('qos', UUID('3d6f6dfa-54f6-41ee-9b58-9e8b94bfa9e4')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf1e966f-35, col_values=(('external_ids', {'iface-id': 'df1e966f-35ba-4e1e-b92b-e35ba3d79b61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:fb:c9', 'vm-uuid': '530fbde9-c0cf-4f20-9b7c-b91296394e2e'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:54 user nova-compute[74534]: INFO os_vif [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35')
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:08:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No VIF found with MAC fa:16:3e:b9:fb:c9, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:08:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updated VIF entry in instance network info cache for port df1e966f-35ba-4e1e-b92b-e35ba3d79b61. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:08:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updating instance_info_cache with network_info: [{"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:08:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-26a09554-2156-413e-b58d-d0806df0e6f0 req-a90abc70-6281-425a-b252-1a82d2e03b21 service nova] Releasing lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-9ec3661f-5219-4752-b940-bd804f526385 req-f7cee31b-451d-4417-8541-f3d562dfca05 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9ec3661f-5219-4752-b940-bd804f526385 req-f7cee31b-451d-4417-8541-f3d562dfca05 service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9ec3661f-5219-4752-b940-bd804f526385 req-f7cee31b-451d-4417-8541-f3d562dfca05 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9ec3661f-5219-4752-b940-bd804f526385 req-f7cee31b-451d-4417-8541-f3d562dfca05 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-9ec3661f-5219-4752-b940-bd804f526385 req-f7cee31b-451d-4417-8541-f3d562dfca05 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:56 user nova-compute[74534]: WARNING nova.compute.manager [req-9ec3661f-5219-4752-b940-bd804f526385 req-f7cee31b-451d-4417-8541-f3d562dfca05 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received unexpected event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with vm_state building and task_state spawning.
Nov 02 12:08:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:08:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance spawned successfully.
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-c0ff5489-b2f1-4fbc-af02-318e0dcec8bd req-e54c7b64-eaa8-472e-bde1-79f2bd39282e service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c0ff5489-b2f1-4fbc-af02-318e0dcec8bd req-e54c7b64-eaa8-472e-bde1-79f2bd39282e service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c0ff5489-b2f1-4fbc-af02-318e0dcec8bd req-e54c7b64-eaa8-472e-bde1-79f2bd39282e service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c0ff5489-b2f1-4fbc-af02-318e0dcec8bd req-e54c7b64-eaa8-472e-bde1-79f2bd39282e service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-c0ff5489-b2f1-4fbc-af02-318e0dcec8bd req-e54c7b64-eaa8-472e-bde1-79f2bd39282e service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:08:58 user nova-compute[74534]: WARNING nova.compute.manager [req-c0ff5489-b2f1-4fbc-af02-318e0dcec8bd req-e54c7b64-eaa8-472e-bde1-79f2bd39282e service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received unexpected event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with vm_state building and task_state spawning.
Nov 02 12:08:58 user nova-compute[74534]: INFO nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 02 12:08:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:08:58 user nova-compute[74534]: INFO nova.compute.manager [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Took 7.26 seconds to build instance.
Nov 02 12:08:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-76ca91c5-33d8-438b-9205-982fbb5620f3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.385s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:08:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:09:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:03 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7551MB free_disk=25.375324249267578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 60fef407-d916-4310-b722-465edfac927b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 20efc112-72c3-4d40-ae01-d1e827bc2fc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 0be2a397-b69d-46fc-a5c3-5f50f92a6781 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:09:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:09:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VznQASrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:14 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:14 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:14 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[78040703-fb82-483b-b57c-7ccf448e36eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:09:14 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aad965-d320-41ab-b43c-350742b86e35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2] added
Nov 02 12:09:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f05f7-a529-4201-829a-572cda25c983]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9643baf2-b7a0-494f-9aba-7b7ac570074e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VznQASrd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VznQASrd" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae5ba61-2d6b-41cf-b22a-d26c61885b9b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VznQASrd'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d44869-aadb-47fa-8acb-7c82741f8ac8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e4415-06a9-4824-862c-390640d4eebf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d7257-633a-4b2e-be37-45cce16d3cee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260]
Nov 02 12:09:14 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b473f178-4e93-462e-a5c4-6781192e6f95]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8bb925-cfca-413d-bc17-349d66252090]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:14 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660b0f1-ab60-4873-a406-c94ea9905599]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VznQASrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:09:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23362353133366638', 'path': '/dev/sdh'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362353133366638', 'path': '/dev/sdh'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:09:15 user nova-compute[74534]: DEBUG nova.objects.instance [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'flavor' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:09:15 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:09:15 user nova-compute[74534]:   <source dev="/dev/sdh"/>
Nov 02 12:09:15 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:09:15 user nova-compute[74534]:   <serial>58ba8952-292f-4352-9cdf-ecaec6db2af2</serial>
Nov 02 12:09:15 user nova-compute[74534]: </disk>
Nov 02 12:09:15 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No VIF found with MAC fa:16:3e:eb:98:c7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7164eba-3249-4ef3-b62e-e4f200ab1b68 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.952s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXQPFDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:16 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:16 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:16 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cb0eee-212e-4c12-88a7-6782f089a09c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:09:16 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37a79e0-1851-4900-9158-4966990bac4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a] added
Nov 02 12:09:16 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe38798-4670-450c-b323-cbca3a013df3]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7cc791-a570-4163-afd6-103d22f7f604]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiXQPFDR {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xiXQPFDR" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b05c67-7ca4-4e5d-afe4-df0c34637d8b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xiXQPFDR'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada077d7-5655-492b-8796-0b3519f0e02a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9dfe0c-4c9b-4fb6-8103-8f20cc5f7fb9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[47df954b-acd8-4b37-93a7-becb465d7c32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260]
Nov 02 12:09:16 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:16 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f325e52-d83e-4eae-8efb-09f5e239468f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff33b58-bbf7-499a-a3df-dc677e7486cb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:16 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:16 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1719e7c-b0ae-41d2-b411-9ba263fc5a7d]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXQPFDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:09:16 user nova-compute[74534]: INFO nova.compute.manager [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Rescuing
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23064376561643430', 'path': '/dev/sdi'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064376561643430', 'path': '/dev/sdi'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lazy-loading 'flavor' on Instance uuid 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:09:17 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:09:17 user nova-compute[74534]:   <source dev="/dev/sdi"/>
Nov 02 12:09:17 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:09:17 user nova-compute[74534]:   <serial>6decd5c3-0e06-47f4-990f-3dc007ec3d7a</serial>
Nov 02 12:09:17 user nova-compute[74534]: </disk>
Nov 02 12:09:17 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-bbd901da-9cf9-49cf-91b2-359b26bf9bf6 req-03044120-b2b1-45d3-ace8-433cf24cd416 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bbd901da-9cf9-49cf-91b2-359b26bf9bf6 req-03044120-b2b1-45d3-ace8-433cf24cd416 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bbd901da-9cf9-49cf-91b2-359b26bf9bf6 req-03044120-b2b1-45d3-ace8-433cf24cd416 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bbd901da-9cf9-49cf-91b2-359b26bf9bf6 req-03044120-b2b1-45d3-ace8-433cf24cd416 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-bbd901da-9cf9-49cf-91b2-359b26bf9bf6 req-03044120-b2b1-45d3-ace8-433cf24cd416 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:17 user nova-compute[74534]: WARNING nova.compute.manager [req-bbd901da-9cf9-49cf-91b2-359b26bf9bf6 req-03044120-b2b1-45d3-ace8-433cf24cd416 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] No VIF found with MAC fa:16:3e:b6:67:db, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1004d3c9-a953-488e-8235-d6d875cc258d tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.514s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "60fef407-d916-4310-b722-465edfac927b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "60fef407-d916-4310-b722-465edfac927b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "60fef407-d916-4310-b722-465edfac927b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "60fef407-d916-4310-b722-465edfac927b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "60fef407-d916-4310-b722-465edfac927b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:18 user nova-compute[74534]: INFO nova.compute.manager [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Terminating instance
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:18 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance destroyed successfully.
Nov 02 12:09:18 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Attempting a stable device rescue
Nov 02 12:09:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74534) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance directory exists: not creating {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 12:09:18 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Creating image(s)
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "38315b445690f32b4b7a167d106562a8e9bdf246" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "38315b445690f32b4b7a167d106562a8e9bdf246" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-680f8a15-4242-4b6d-827f-69a01a227b7b req-b645e59e-67b6-4726-abe1-d5b5660577fa service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-vif-unplugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680f8a15-4242-4b6d-827f-69a01a227b7b req-b645e59e-67b6-4726-abe1-d5b5660577fa service nova] Acquiring lock "60fef407-d916-4310-b722-465edfac927b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680f8a15-4242-4b6d-827f-69a01a227b7b req-b645e59e-67b6-4726-abe1-d5b5660577fa service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680f8a15-4242-4b6d-827f-69a01a227b7b req-b645e59e-67b6-4726-abe1-d5b5660577fa service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-680f8a15-4242-4b6d-827f-69a01a227b7b req-b645e59e-67b6-4726-abe1-d5b5660577fa service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] No waiting events found dispatching network-vif-unplugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-680f8a15-4242-4b6d-827f-69a01a227b7b req-b645e59e-67b6-4726-abe1-d5b5660577fa service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-vif-unplugged-d2a603eb-455a-48dd-ab21-b4885e6a486f for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-8dfcb300-fa14-4454-9ba2-4d227dc5435e req-9e02fd93-c81f-4974-97bc-d48c49a75570 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8dfcb300-fa14-4454-9ba2-4d227dc5435e req-9e02fd93-c81f-4974-97bc-d48c49a75570 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8dfcb300-fa14-4454-9ba2-4d227dc5435e req-9e02fd93-c81f-4974-97bc-d48c49a75570 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8dfcb300-fa14-4454-9ba2-4d227dc5435e req-9e02fd93-c81f-4974-97bc-d48c49a75570 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-8dfcb300-fa14-4454-9ba2-4d227dc5435e req-9e02fd93-c81f-4974-97bc-d48c49a75570 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:20 user nova-compute[74534]: WARNING nova.compute.manager [req-8dfcb300-fa14-4454-9ba2-4d227dc5435e req-9e02fd93-c81f-4974-97bc-d48c49a75570 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:20 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 60fef407-d916-4310-b722-465edfac927b] Instance destroyed successfully.
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lazy-loading 'resources' on Instance uuid 60fef407-d916-4310-b722-465edfac927b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1337830386',display_name='tempest-VolumesAssistedSnapshotsTest-server-1337830386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1337830386',id=10,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ+Axk1Nw4Qm/kvvRJIahj78glQYkPAJm5n/+nDp1s/rL65jJE3PMrECglK7rSaDh7XHHemigFd9mi2ESoX0LNjwxcg24mTS3VGMBDSRNwwSH8IwXPYG6JddSFuEayPsA==',key_name='tempest-keypair-1628464273',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c26b6ac0b3c4d2f80c174892542ea49',ramdisk_id='',reservation_id='r-8baw4hp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-637081917',owner_user_name='tempest-VolumesAssistedSnapshotsTest-637081917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c5ca52592a646bbb11e735d7f500f51',uuid=60fef407-d916-4310-b722-465edfac927b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Converting VIF {"id": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "address": "fa:16:3e:69:0d:e0", "network": {"id": "b075f9f2-da61-4573-b3bb-d05f976a0917", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-260169626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c26b6ac0b3c4d2f80c174892542ea49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a603eb-45", "ovs_interfaceid": "d2a603eb-455a-48dd-ab21-b4885e6a486f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=d2a603eb-455a-48dd-ab21-b4885e6a486f,network=Network(b075f9f2-da61-4573-b3bb-d05f976a0917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a603eb-45') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG os_vif [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=d2a603eb-455a-48dd-ab21-b4885e6a486f,network=Network(b075f9f2-da61-4573-b3bb-d05f976a0917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a603eb-45') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a603eb-45, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d894424-f322-4cd6-85fb-7a25b8693b4b) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:20 user nova-compute[74534]: INFO os_vif [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:0d:e0,bridge_name='br-int',has_traffic_filtering=True,id=d2a603eb-455a-48dd-ab21-b4885e6a486f,network=Network(b075f9f2-da61-4573-b3bb-d05f976a0917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a603eb-45')
Nov 02 12:09:20 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Deleting instance files /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b_del
Nov 02 12:09:20 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Deletion of /opt/stack/data/nova/instances/60fef407-d916-4310-b722-465edfac927b_del complete
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.virt.images [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] 8a8a8ca0-3b71-4759-8cf2-ef37e7b6e4c7 was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.part /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:20 user nova-compute[74534]: INFO nova.compute.manager [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] [instance: 60fef407-d916-4310-b722-465edfac927b] Took 1.87 seconds to destroy the instance on the hypervisor.
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 60fef407-d916-4310-b722-465edfac927b] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 60fef407-d916-4310-b722-465edfac927b] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.part /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.converted" returned: 0 in 0.505s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-f913d415-45a2-4261-b59b-7be983692e40 req-bc60d01d-029e-45a8-9630-7e6aacbf8763 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f913d415-45a2-4261-b59b-7be983692e40 req-bc60d01d-029e-45a8-9630-7e6aacbf8763 service nova] Acquiring lock "60fef407-d916-4310-b722-465edfac927b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f913d415-45a2-4261-b59b-7be983692e40 req-bc60d01d-029e-45a8-9630-7e6aacbf8763 service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f913d415-45a2-4261-b59b-7be983692e40 req-bc60d01d-029e-45a8-9630-7e6aacbf8763 service nova] Lock "60fef407-d916-4310-b722-465edfac927b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-f913d415-45a2-4261-b59b-7be983692e40 req-bc60d01d-029e-45a8-9630-7e6aacbf8763 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] No waiting events found dispatching network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:20 user nova-compute[74534]: WARNING nova.compute.manager [req-f913d415-45a2-4261-b59b-7be983692e40 req-bc60d01d-029e-45a8-9630-7e6aacbf8763 service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received unexpected event network-vif-plugged-d2a603eb-455a-48dd-ab21-b4885e6a486f for instance with vm_state active and task_state deleting.
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "38315b445690f32b4b7a167d106562a8e9bdf246" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.275s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "38315b445690f32b4b7a167d106562a8e9bdf246" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "38315b445690f32b4b7a167d106562a8e9bdf246" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Stashing vm_state: active {{(pid=74534) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 60fef407-d916-4310-b722-465edfac927b] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:21 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 60fef407-d916-4310-b722-465edfac927b] Took 0.79 seconds to deallocate network for instance.
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246 --force-share --output=json" returned: 0 in 0.233s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246,backing_fmt=raw /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246,backing_fmt=raw /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue" returned: 0 in 0.065s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "38315b445690f32b4b7a167d106562a8e9bdf246" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'migration_context' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Object Instance<c7d59af9-1ab5-43b4-84af-3a27cd182e29> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Start _get_guest_xml network_info=[{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "vif_mac": "fa:16:3e:eb:98:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8a8a8ca0-3b71-4759-8cf2-ef37e7b6e4c7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'guest_format': None, 'attachment_id': 'cc6e7af8-d8a7-4b0e-a929-3e3eb0744e3f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VznQASrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c7d59af9-1ab5-43b4-84af-3a27cd182e29', 'attached_at': '', 'detached_at': '', 'volume_id': '58ba8952-292f-4352-9cdf-ecaec6db2af2', 'serial': '58ba8952-292f-4352-9cdf-ecaec6db2af2'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'resources' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Object Instance<c7d59af9-1ab5-43b4-84af-3a27cd182e29> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'numa_topology' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Object Instance<c7d59af9-1ab5-43b4-84af-3a27cd182e29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:21 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:21 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Object Instance<c7d59af9-1ab5-43b4-84af-3a27cd182e29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VznQASrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:21 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:21 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:21 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b95ddc-1d1b-4f4b-8d4e-56ebe6355663]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VznQASrd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 12:09:21 user nova-compute[74534]: node.name = iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:09:21 user nova-compute[74534]: node.tpgt = -1
Nov 02 12:09:21 user nova-compute[74534]: node.startup = automatic
Nov 02 12:09:21 user nova-compute[74534]: node.leading_login = No
Nov 02 12:09:21 user nova-compute[74534]: iface.iscsi_ifacename = default
Nov 02 12:09:21 user nova-compute[74534]: iface.net_ifacename = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.ipaddress = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.prefix_len = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.hwaddress = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.transport_name = tcp
Nov 02 12:09:21 user nova-compute[74534]: iface.initiatorname = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.state = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.vlan_id = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.vlan_priority = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.vlan_state = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.iface_num = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.mtu = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.port = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.bootproto = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.subnet_mask = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.gateway = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_alt_client_id = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_dns = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_learn_iqn = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_vendor_id_state = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_vendor_id = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.dhcp_slp_da = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.fragmentation = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.gratuitous_arp = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.incoming_forwarding = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.tos_state = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.tos = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.ttl = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.delayed_ack = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.tcp_nagle = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.tcp_wsf_state = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.tcp_wsf = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.tcp_timer_scale = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.tcp_timestamp = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.redirect = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.def_task_mgmt_timeout = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.header_digest = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.data_digest = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.immediate_data = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.initial_r2t = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.data_seq_inorder = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.data_pdu_inorder = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.erl = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.max_receive_data_len = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.first_burst_len = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.max_outstanding_r2t = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.max_burst_len = 0
Nov 02 12:09:21 user nova-compute[74534]: iface.chap_auth = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.bidi_chap = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.strict_login_compliance = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.discovery_auth = <empty>
Nov 02 12:09:21 user nova-compute[74534]: iface.discovery_logout = <empty>
Nov 02 12:09:21 user nova-compute[74534]: node.discovery_address = <empty>
Nov 02 12:09:21 user nova-compute[74534]: node.discovery_port = 0
Nov 02 12:09:21 user nova-compute[74534]: node.discovery_type = static
Nov 02 12:09:21 user nova-compute[74534]: node.session.initial_cmdsn = 0
Nov 02 12:09:21 user nova-compute[74534]: node.session.initial_login_retry_max = 8
Nov 02 12:09:21 user nova-compute[74534]: node.session.xmit_thread_priority = -20
Nov 02 12:09:21 user nova-compute[74534]: node.session.cmds_max = 128
Nov 02 12:09:21 user nova-compute[74534]: node.session.queue_depth = 32
Nov 02 12:09:21 user nova-compute[74534]: node.session.nr_sessions = 1
Nov 02 12:09:21 user nova-compute[74534]: node.session.auth.authmethod = CHAP
Nov 02 12:09:21 user nova-compute[74534]: node.session.auth.username = VznQASrd
Nov 02 12:09:21 user nova-compute[74534]: node.session.auth.password = ***
Nov 02 12:09:21 user nova-compute[74534]: node.session.auth.username_in = <empty>
Nov 02 12:09:21 user nova-compute[74534]: node.session.auth.password_in = <empty>
Nov 02 12:09:21 user nova-compute[74534]: node.session.auth.chap_algs = MD5
Nov 02 12:09:21 user nova-compute[74534]: node.session.timeo.replacement_timeout = 120
Nov 02 12:09:21 user nova-compute[74534]: node.session.err_timeo.abort_timeout = 15
Nov 02 12:09:21 user nova-compute[74534]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 12:09:21 user nova-compute[74534]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 12:09:21 user nova-compute[74534]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.FastAbort = Yes
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.InitialR2T = No
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.ImmediateData = Yes
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.MaxConnections = 1
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 12:09:21 user nova-compute[74534]: node.session.iscsi.ERL = 0
Nov 02 12:09:21 user nova-compute[74534]: node.session.scan = manual
Nov 02 12:09:21 user nova-compute[74534]: node.session.reopen_max = 0
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].address = 172.16.0.220
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].port = 3260
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].startup = manual
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].tcp.window_size = 524288
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].tcp.type_of_service = 0
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].timeo.logout_timeout = 15
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].timeo.login_timeout = 15
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].timeo.auth_timeout = 45
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].iscsi.DataDigest = None
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].iscsi.IFMarker = No
Nov 02 12:09:21 user nova-compute[74534]: node.conn[0].iscsi.OFMarker = No
Nov 02 12:09:21 user nova-compute[74534]: # END RECORD
Nov 02 12:09:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b11e7b9-d2eb-4784-8776-61024a8b4f55]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8dce1-2b5b-470b-a3c4-6ce1d7d5f3b7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VznQASrd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VznQASrd" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee1bf2-2149-4185-92d6-376c18846fef]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VznQASrd'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edfc617-0c6b-45c2-b855-cf83b0ada69f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc74b3-0842-414a-96b3-805c5e18d884]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:21 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] HCTL ('39', '0', '0', 0) found on session 12 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e890fb-aa99-46d9-94fc-26a5b9333ecd]: (4, ('0 0 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Searching for a device in session 12 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VznQASrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] <== connect_volume: return (202ms) {'type': 'block', 'scsi_wwn': '23362353133366638', 'path': '/dev/sdh'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362353133366638', 'path': '/dev/sdh'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-480445214',display_name='tempest-ServerStableDeviceRescueTest-server-480445214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-480445214',id=6,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdGCJP5nBWInjL/LmHQ0hFRZI4+zAHfsMY/eQ8JRXS8qeH39DzGK8bEZMtTDdEaZ8ykLyjLAanmn0+y2XCypb1IU5QvNEkiyzrDTZJsvCN9KG+79zach52DWPhIgS2JIg==',key_name='tempest-keypair-1756371081',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ca53e8b45e248c8accd59e5d57e4fbc',ramdisk_id='',reservation_id='r-1sn0qowx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1725617346',owner_user_name='tempest-ServerStableDeviceRescueTest-1725617346-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e552c4c23df4919957749b5a4b1447d',uuid=c7d59af9-1ab5-43b4-84af-3a27cd182e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "vif_mac": "fa:16:3e:eb:98:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converting VIF {"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "vif_mac": "fa:16:3e:eb:98:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'pci_devices' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.524s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.objects.base [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Object Instance<c7d59af9-1ab5-43b4-84af-3a27cd182e29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:09:21 user nova-compute[74534]:   <uuid>c7d59af9-1ab5-43b4-84af-3a27cd182e29</uuid>
Nov 02 12:09:21 user nova-compute[74534]:   <name>instance-00000006</name>
Nov 02 12:09:21 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:09:21 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:09:21 user nova-compute[74534]:   <metadata>
Nov 02 12:09:21 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:09:21 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:09:21 user nova-compute[74534]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-480445214</nova:name>
Nov 02 12:09:21 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:09:21</nova:creationTime>
Nov 02 12:09:21 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:09:21 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:09:21 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:09:21 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:09:21 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:09:21 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:09:21 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:09:21 user nova-compute[74534]:       <nova:owner>
Nov 02 12:09:21 user nova-compute[74534]:         <nova:user uuid="4e552c4c23df4919957749b5a4b1447d">tempest-ServerStableDeviceRescueTest-1725617346-project-member</nova:user>
Nov 02 12:09:21 user nova-compute[74534]:         <nova:project uuid="8ca53e8b45e248c8accd59e5d57e4fbc">tempest-ServerStableDeviceRescueTest-1725617346</nova:project>
Nov 02 12:09:21 user nova-compute[74534]:       </nova:owner>
Nov 02 12:09:21 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:09:21 user nova-compute[74534]:       <nova:ports>
Nov 02 12:09:21 user nova-compute[74534]:         <nova:port uuid="e87382cc-9797-48c4-b9b7-eaf7c1d85ea2">
Nov 02 12:09:21 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:09:21 user nova-compute[74534]:         </nova:port>
Nov 02 12:09:21 user nova-compute[74534]:       </nova:ports>
Nov 02 12:09:21 user nova-compute[74534]:     </nova:instance>
Nov 02 12:09:21 user nova-compute[74534]:   </metadata>
Nov 02 12:09:21 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:09:21 user nova-compute[74534]:     <system>
Nov 02 12:09:21 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:09:21 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:09:21 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:09:21 user nova-compute[74534]:       <entry name="serial">c7d59af9-1ab5-43b4-84af-3a27cd182e29</entry>
Nov 02 12:09:21 user nova-compute[74534]:       <entry name="uuid">c7d59af9-1ab5-43b4-84af-3a27cd182e29</entry>
Nov 02 12:09:21 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:09:21 user nova-compute[74534]:     </system>
Nov 02 12:09:21 user nova-compute[74534]:   </sysinfo>
Nov 02 12:09:21 user nova-compute[74534]:   <os>
Nov 02 12:09:21 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:09:21 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:09:21 user nova-compute[74534]:   </os>
Nov 02 12:09:21 user nova-compute[74534]:   <features>
Nov 02 12:09:21 user nova-compute[74534]:     <acpi/>
Nov 02 12:09:21 user nova-compute[74534]:     <apic/>
Nov 02 12:09:21 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:09:21 user nova-compute[74534]:   </features>
Nov 02 12:09:21 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:09:21 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:09:21 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:09:21 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:09:21 user nova-compute[74534]:   </clock>
Nov 02 12:09:21 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:09:21 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:09:21 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:09:21 user nova-compute[74534]:   </cpu>
Nov 02 12:09:21 user nova-compute[74534]:   <devices>
Nov 02 12:09:21 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:09:21 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:09:21 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk"/>
Nov 02 12:09:21 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:09:21 user nova-compute[74534]:     </disk>
Nov 02 12:09:21 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:09:21 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:09:21 user nova-compute[74534]:       <source dev="/dev/sdh"/>
Nov 02 12:09:21 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:09:21 user nova-compute[74534]:       <serial>58ba8952-292f-4352-9cdf-ecaec6db2af2</serial>
Nov 02 12:09:21 user nova-compute[74534]:     </disk>
Nov 02 12:09:21 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:09:21 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:09:21 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue"/>
Nov 02 12:09:21 user nova-compute[74534]:       <target dev="vdc" bus="virtio"/>
Nov 02 12:09:21 user nova-compute[74534]:       <boot order="1"/>
Nov 02 12:09:21 user nova-compute[74534]:     </disk>
Nov 02 12:09:21 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:09:21 user nova-compute[74534]:       <mac address="fa:16:3e:eb:98:c7"/>
Nov 02 12:09:21 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:21 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:09:21 user nova-compute[74534]:       <target dev="tape87382cc-97"/>
Nov 02 12:09:21 user nova-compute[74534]:     </interface>
Nov 02 12:09:21 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:09:21 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/console.log" append="off"/>
Nov 02 12:09:21 user nova-compute[74534]:     </serial>
Nov 02 12:09:21 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:09:21 user nova-compute[74534]:     <video>
Nov 02 12:09:21 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:21 user nova-compute[74534]:     </video>
Nov 02 12:09:21 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:09:21 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:09:21 user nova-compute[74534]:     </rng>
Nov 02 12:09:21 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:09:21 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:09:21 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:09:21 user nova-compute[74534]:     </memballoon>
Nov 02 12:09:21 user nova-compute[74534]:   </devices>
Nov 02 12:09:21 user nova-compute[74534]: </domain>
Nov 02 12:09:21 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:09:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance destroyed successfully.
Nov 02 12:09:21 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Deleted allocations for instance 60fef407-d916-4310-b722-465edfac927b
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:09:21 user nova-compute[74534]: INFO nova.compute.claims [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Claim successful on node user
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] No VIF found with MAC fa:16:3e:eb:98:c7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:09:21 user nova-compute[74534]: INFO nova.compute.resource_tracker [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating resource usage from migration 2c0b9eaf-3742-413d-b0f9-e06585c5c923
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a922877a-b469-4c6c-8afe-20ff5d3137eb tempest-VolumesAssistedSnapshotsTest-637081917 tempest-VolumesAssistedSnapshotsTest-637081917-project-member] Lock "60fef407-d916-4310-b722-465edfac927b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.553s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:21 user nova-compute[74534]: INFO nova.compute.manager [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Terminating instance
Nov 02 12:09:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-e16d94d1-40bd-43ff-81de-929a8e2f34fb req-abc4aa1f-4826-486d-b35d-e6ed92a24a04 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-unplugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e16d94d1-40bd-43ff-81de-929a8e2f34fb req-abc4aa1f-4826-486d-b35d-e6ed92a24a04 service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e16d94d1-40bd-43ff-81de-929a8e2f34fb req-abc4aa1f-4826-486d-b35d-e6ed92a24a04 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e16d94d1-40bd-43ff-81de-929a8e2f34fb req-abc4aa1f-4826-486d-b35d-e6ed92a24a04 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-e16d94d1-40bd-43ff-81de-929a8e2f34fb req-abc4aa1f-4826-486d-b35d-e6ed92a24a04 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-unplugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-e16d94d1-40bd-43ff-81de-929a8e2f34fb req-abc4aa1f-4826-486d-b35d-e6ed92a24a04 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-unplugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.753s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:22 user nova-compute[74534]: INFO nova.compute.manager [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Migrating
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:22 user nova-compute[74534]: INFO nova.compute.rpcapi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquired lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-494db26f-f4f0-412d-879f-86c9717f215c req-4d7a744a-75db-4b9a-a081-3f7bc92f3f8a service nova] [instance: 60fef407-d916-4310-b722-465edfac927b] Received event network-vif-deleted-d2a603eb-455a-48dd-ab21-b4885e6a486f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Releasing lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Starting migrate_disk_and_power_off {{(pid=74534) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 12:09:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Instance destroyed successfully.
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lazy-loading 'resources' on Instance uuid 33b75f56-25f3-42b9-a699-5cf4e3bf4f53 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1100608694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1100608694',id=9,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIz51X7x9wz/FCINg1fktGent5zCRrhjXcJd0EghQjcLZX1maTHiEj5ReCd2DThrkYiElVH1+5b44cnX8U2NLeECqtEBO0PSx+ilTUrPilcRtq6v846MPM2xQMrQw9D5w==',key_name='tempest-keypair-1267282707',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3c15ccf99034cb9bdc6ca3e19c1ac29',ramdisk_id='',reservation_id='r-n39ydvdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-997566028',owner_user_name='tempest-TaggedAttachmentsTest-997566028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90050c453aad4f63b4a7615a0ff0f560',uuid=33b75f56-25f3-42b9-a699-5cf4e3bf4f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converting VIF {"id": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "address": "fa:16:3e:31:a9:8a", "network": {"id": "59e93dad-1d76-40aa-9484-457eccf21c14", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2101079414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3c15ccf99034cb9bdc6ca3e19c1ac29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e801a89-2f", "ovs_interfaceid": "8e801a89-2f1c-41ef-85c2-67e6ed38ce9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:a9:8a,bridge_name='br-int',has_traffic_filtering=True,id=8e801a89-2f1c-41ef-85c2-67e6ed38ce9c,network=Network(59e93dad-1d76-40aa-9484-457eccf21c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e801a89-2f') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG os_vif [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:a9:8a,bridge_name='br-int',has_traffic_filtering=True,id=8e801a89-2f1c-41ef-85c2-67e6ed38ce9c,network=Network(59e93dad-1d76-40aa-9484-457eccf21c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e801a89-2f') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e801a89-2f, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3de2e357-6765-48ff-88a7-a9496d8abbed) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: INFO os_vif [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:a9:8a,bridge_name='br-int',has_traffic_filtering=True,id=8e801a89-2f1c-41ef-85c2-67e6ed38ce9c,network=Network(59e93dad-1d76-40aa-9484-457eccf21c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e801a89-2f')
Nov 02 12:09:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Deleting instance files /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53_del
Nov 02 12:09:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Deletion of /opt/stack/data/nova/instances/33b75f56-25f3-42b9-a699-5cf4e3bf4f53_del complete
Nov 02 12:09:23 user nova-compute[74534]: INFO nova.compute.manager [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 02 12:09:23 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-e0316725-0f72-4369-a856-540d36d06c04 req-7ff5da5e-fd4f-4e01-a3d6-c8b31597eea8 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received event network-vif-unplugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e0316725-0f72-4369-a856-540d36d06c04 req-7ff5da5e-fd4f-4e01-a3d6-c8b31597eea8 service nova] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e0316725-0f72-4369-a856-540d36d06c04 req-7ff5da5e-fd4f-4e01-a3d6-c8b31597eea8 service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e0316725-0f72-4369-a856-540d36d06c04 req-7ff5da5e-fd4f-4e01-a3d6-c8b31597eea8 service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-e0316725-0f72-4369-a856-540d36d06c04 req-7ff5da5e-fd4f-4e01-a3d6-c8b31597eea8 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] No waiting events found dispatching network-vif-unplugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:23 user nova-compute[74534]: WARNING nova.compute.manager [req-e0316725-0f72-4369-a856-540d36d06c04 req-7ff5da5e-fd4f-4e01-a3d6-c8b31597eea8 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received unexpected event network-vif-unplugged-6bd2394c-d906-4662-a101-dc05b7f71de0 for instance with vm_state active and task_state resize_migrating.
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance destroyed successfully.
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2130605991',display_name='tempest-ServerActionsTestOtherB-server-2130605991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2130605991',id=3,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyXevzzyGgg4+GaKM5XRqX2ueUd/PMUbZw4+E9/82E2Xdqds5ls0nogBKehj5TA3RwtugaQqFt5VCxoMw1V4Q2Y1sw8BfaMErazKbOIIAiJ2DZFBh8oNzVRdHN+0rybZw==',key_name='tempest-keypair-1958950750',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c253a7a30a6841c0a231f30d9da9b66c',ramdisk_id='',reservation_id='r-9fi998ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1657074801',owner_user_name='tempest-ServerActionsTestOtherB-1657074801-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e63b6c90e2784a209a5a7300b985f47c',uuid=603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-736870664-network", "vif_mac": "fa:16:3e:b6:67:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converting VIF {"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-736870664-network", "vif_mac": "fa:16:3e:b6:67:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_vif [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bd2394c-d9, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e04179e3-ee4b-447f-8592-6a586126a0cd) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: INFO os_vif [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9')
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXQPFDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:24 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-e112ccf5-7aa6-4692-a422-173b03d69b4d req-de773fe6-777f-442e-a929-3a3c6b1ccf20 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e112ccf5-7aa6-4692-a422-173b03d69b4d req-de773fe6-777f-442e-a929-3a3c6b1ccf20 service nova] Acquiring lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e112ccf5-7aa6-4692-a422-173b03d69b4d req-de773fe6-777f-442e-a929-3a3c6b1ccf20 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e112ccf5-7aa6-4692-a422-173b03d69b4d req-de773fe6-777f-442e-a929-3a3c6b1ccf20 service nova] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-e112ccf5-7aa6-4692-a422-173b03d69b4d req-de773fe6-777f-442e-a929-3a3c6b1ccf20 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] No waiting events found dispatching network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:24 user nova-compute[74534]: WARNING nova.compute.manager [req-e112ccf5-7aa6-4692-a422-173b03d69b4d req-de773fe6-777f-442e-a929-3a3c6b1ccf20 service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received unexpected event network-vif-plugged-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c for instance with vm_state active and task_state deleting.
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.050s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[509342b0-52a4-4dd5-884d-441a1d9894ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:09:24 user nova-compute[74534]: No targets found.
Nov 02 12:09:24 user nova-compute[74534]: iSNS:
Nov 02 12:09:24 user nova-compute[74534]: No targets found.
Nov 02 12:09:24 user nova-compute[74534]: STATIC:
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a
Nov 02 12:09:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:24 user nova-compute[74534]: FIRMWARE:
Nov 02 12:09:24 user nova-compute[74534]: No targets found.
Nov 02 12:09:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:09:24 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:09:24 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f0a24e-dd85-45b6-9754-5256a88bd152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d57aa6-79d0-41a7-8c1a-3c00acac54b4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:24 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c782ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a'): ({'sdi'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Removing single pathed devices sdi {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b7090f-5298-422e-9099-458a9cae867c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7ca6a1-ed70-4179-81c6-5df2f27232e9]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Flushing IO for device /dev/sdi {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[10761d95-359f-441f-a04b-c82bb800f17a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.059s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c8cd2-3139-43ea-a4a3-735748c43d1a]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] SCSI volumes sdi have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c01e55-866a-40e8-b553-c668521fcd9f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Took 1.24 seconds to deallocate network for instance.
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb0b3c-6ba3-4e86-a357-485a15f4baaa]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260]
Nov 02 12:09:24 user nova-compute[74534]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d3245-62b5-49e7-b693-54acd429bf67]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] <== disconnect_volume: return (487ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:09:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-b3e0ec11-513b-4c47-9106-1cfab71bd1ea req-94dee16a-050a-4a90-9281-10354a126cca service nova] [instance: 33b75f56-25f3-42b9-a699-5cf4e3bf4f53] Received event network-vif-deleted-8e801a89-2f1c-41ef-85c2-67e6ed38ce9c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize/disk /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.685s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:25 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Deleted allocations for instance 33b75f56-25f3-42b9-a699-5cf4e3bf4f53
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received event network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] No waiting events found dispatching network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:25 user nova-compute[74534]: WARNING nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received unexpected event network-vif-plugged-6bd2394c-d906-4662-a101-dc05b7f71de0 for instance with vm_state active and task_state resize_migrating.
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:25 user nova-compute[74534]: WARNING nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:25 user nova-compute[74534]: WARNING nova.compute.manager [req-48505e71-a3eb-4bc0-83c8-58b8ad6e2bb9 req-8b433092-87d4-4620-ad93-3e20388b369b service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f560d826-50b7-42fe-a65b-2294369c2f5d tempest-TaggedAttachmentsTest-997566028 tempest-TaggedAttachmentsTest-997566028-project-member] Lock "33b75f56-25f3-42b9-a699-5cf4e3bf4f53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.775s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "cp -r /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize/disk /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk" returned: 0 in 0.593s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize/disk.info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk.info {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] CMD "cp -r /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize/disk.info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk.info" returned: 0 in 0.037s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ddc113b0-fc36-478c-bda5-edc540272d53 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-changed-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing instance network info cache due to event network-changed-b63ba33b-30a3-4a5a-ad82-a446542e96a9. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] Acquiring lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] Acquired lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG nova.network.neutron [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Refreshing network info cache for port b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Port 6bd2394c-d906-4662-a101-dc05b7f71de0 binding to destination host user is already ACTIVE {{(pid=74534) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG nova.network.neutron [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updated VIF entry in instance network info cache for port b63ba33b-30a3-4a5a-ad82-a446542e96a9. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG nova.network.neutron [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [{"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9d329834-27c5-418a-8a2f-2e3c7d258569 req-18826c17-7df6-417c-88c7-e4520b120fcd service nova] Releasing lock "refresh_cache-20efc112-72c3-4d40-ae01-d1e827bc2fc2" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquired lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [{"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Releasing lock "refresh_cache-603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG os_brick.utils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb74044d-1468-4a2f-9f12-ba04b37e0564]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9381e2e-29f1-4b51-b6f7-1571061c8561]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205a385-6b6c-461e-99c8-65fa303cb73d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0552a568-058a-46ce-8235-a445047a5af3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:09:28 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:09:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea711a34-82bf-47d9-acda-a36b2c81da3e]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:09:28 user nova-compute[74534]: DEBUG os_brick.utils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:09:29 user nova-compute[74534]: INFO nova.compute.claims [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Claim successful on node user
Nov 02 12:09:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.network.neutron [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:09:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.policy [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9b5a220e5284d76b8a1ee606a2104fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c632d2880cae4fee92c4b408c9c2aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:30 user nova-compute[74534]: INFO nova.compute.manager [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Terminating instance
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:09:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Creating image(s)
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "/opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "/opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "/opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.231s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.264s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-66f04925-d745-4501-a3c2-d5df41e64659 req-d60b7271-1c13-473f-99a1-d6e143774d60 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66f04925-d745-4501-a3c2-d5df41e64659 req-d60b7271-1c13-473f-99a1-d6e143774d60 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66f04925-d745-4501-a3c2-d5df41e64659 req-d60b7271-1c13-473f-99a1-d6e143774d60 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66f04925-d745-4501-a3c2-d5df41e64659 req-d60b7271-1c13-473f-99a1-d6e143774d60 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-66f04925-d745-4501-a3c2-d5df41e64659 req-d60b7271-1c13-473f-99a1-d6e143774d60 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-unplugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-66f04925-d745-4501-a3c2-d5df41e64659 req-d60b7271-1c13-473f-99a1-d6e143774d60 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk 1073741824" returned: 0 in 0.083s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-ca2e4037-f58f-416d-ab00-55f9019af0d6 req-0e24d8be-f22c-43f8-84ff-a731f0b91c2c service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ca2e4037-f58f-416d-ab00-55f9019af0d6 req-0e24d8be-f22c-43f8-84ff-a731f0b91c2c service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ca2e4037-f58f-416d-ab00-55f9019af0d6 req-0e24d8be-f22c-43f8-84ff-a731f0b91c2c service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ca2e4037-f58f-416d-ab00-55f9019af0d6 req-0e24d8be-f22c-43f8-84ff-a731f0b91c2c service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-ca2e4037-f58f-416d-ab00-55f9019af0d6 req-0e24d8be-f22c-43f8-84ff-a731f0b91c2c service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-unplugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-ca2e4037-f58f-416d-ab00-55f9019af0d6 req-0e24d8be-f22c-43f8-84ff-a731f0b91c2c service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-23a19e19-7793-45b9-ac52-7948d610d85b for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e234815-8c8e-4b65-b5d9-1b50add04024 req-1a625972-5fb3-4490-8a99-d25b6e84588d service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e234815-8c8e-4b65-b5d9-1b50add04024 req-1a625972-5fb3-4490-8a99-d25b6e84588d service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e234815-8c8e-4b65-b5d9-1b50add04024 req-1a625972-5fb3-4490-8a99-d25b6e84588d service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e234815-8c8e-4b65-b5d9-1b50add04024 req-1a625972-5fb3-4490-8a99-d25b6e84588d service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e234815-8c8e-4b65-b5d9-1b50add04024 req-1a625972-5fb3-4490-8a99-d25b6e84588d service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-unplugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e234815-8c8e-4b65-b5d9-1b50add04024 req-1a625972-5fb3-4490-8a99-d25b6e84588d service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.224s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Cannot resize image /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Ensure instance console log exists: /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG nova.network.neutron [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Successfully created port: 1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Instance destroyed successfully.
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.objects.instance [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lazy-loading 'resources' on Instance uuid 20efc112-72c3-4d40-ae01-d1e827bc2fc2 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:1d:57,bridge_name='br-int',has_traffic_filtering=True,id=b63ba33b-30a3-4a5a-ad82-a446542e96a9,network=Network(3308069e-715c-4071-ad60-f63f247e0dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63ba33b-30') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:1d:57,bridge_name='br-int',has_traffic_filtering=True,id=b63ba33b-30a3-4a5a-ad82-a446542e96a9,network=Network(3308069e-715c-4071-ad60-f63f247e0dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63ba33b-30') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb63ba33b-30, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.neutron [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Successfully updated port: 1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquired lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.neutron [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'info_cache' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "refresh_cache-516a3fb1-8fcf-400f-851e-ebde11f99928" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquired lock "refresh_cache-516a3fb1-8fcf-400f-851e-ebde11f99928" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.neutron [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97709023-cdd3-42dd-a095-2acc2b8b69ed) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.objects.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.neutron [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: INFO os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:1d:57,bridge_name='br-int',has_traffic_filtering=True,id=b63ba33b-30a3-4a5a-ad82-a446542e96a9,network=Network(3308069e-715c-4071-ad60-f63f247e0dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63ba33b-30')
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=23a19e19-7793-45b9-ac52-7948d610d85b,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23a19e19-77') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=23a19e19-7793-45b9-ac52-7948d610d85b,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23a19e19-77') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23a19e19-77, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:32 user nova-compute[74534]: WARNING nova.compute.manager [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-b63ba33b-30a3-4a5a-ad82-a446542e96a9 for instance with vm_state active and task_state deleting.
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received event network-changed-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Refreshing instance network info cache due to event network-changed-1c874c94-eb24-43cd-b67c-85e46d133c52. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] Acquiring lock "refresh_cache-516a3fb1-8fcf-400f-851e-ebde11f99928" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d277352f-47ee-4b79-9890-aa5daacadd6f) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-23a19e19-7793-45b9-ac52-7948d610d85b for instance with vm_state active and task_state deleting.
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-unplugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-05342184-c439-49b5-b432-825fb8202d12 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-05342184-c439-49b5-b432-825fb8202d12 for instance with vm_state active and task_state deleting.
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-unplugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.compute.manager [req-22cb565d-aade-421c-b800-9e81d6e47d85 req-e2de53ec-e4b7-47f1-8263-98cc90ccfcf6 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 for instance with vm_state active and task_state deleting.
Nov 02 12:09:33 user nova-compute[74534]: INFO os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=23a19e19-7793-45b9-ac52-7948d610d85b,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23a19e19-77')
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:29:43,bridge_name='br-int',has_traffic_filtering=True,id=05342184-c439-49b5-b432-825fb8202d12,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05342184-c4') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:29:43,bridge_name='br-int',has_traffic_filtering=True,id=05342184-c439-49b5-b432-825fb8202d12,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05342184-c4') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05342184-c4, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bc09551-269a-4ed2-aaf3-1123f34bccdf) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 for instance with vm_state active and task_state deleting.
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-unplugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 for instance with vm_state active and task_state deleting.
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-unplugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-unplugged-9e664875-3ea4-4a54-a7cc-1d24e551117b for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Acquiring lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] No waiting events found dispatching network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.compute.manager [req-9a848e0c-57f9-47e9-9e59-af950a29c3ac req-7e339d36-f86d-4b8a-a161-325595fcdb97 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received unexpected event network-vif-plugged-9e664875-3ea4-4a54-a7cc-1d24e551117b for instance with vm_state active and task_state deleting.
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: INFO os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:29:43,bridge_name='br-int',has_traffic_filtering=True,id=05342184-c439-49b5-b432-825fb8202d12,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap05342184-c4')
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "address": "fa:16:3e:2e:66:4d", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd647ef0-4d", "ovs_interfaceid": "dd647ef0-4d20-41aa-96bf-b9e8041c2c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:4d,bridge_name='br-int',has_traffic_filtering=True,id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd647ef0-4d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:4d,bridge_name='br-int',has_traffic_filtering=True,id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd647ef0-4d') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd647ef0-4d, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48529139-cc85-4e33-a4b2-0c95db3e42a1) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: INFO os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:66:4d,bridge_name='br-int',has_traffic_filtering=True,id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd647ef0-4d')
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:04:52,bridge_name='br-int',has_traffic_filtering=True,id=a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64bd6ed-ab') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:04:52,bridge_name='br-int',has_traffic_filtering=True,id=a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64bd6ed-ab') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa64bd6ed-ab, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e072b28-e899-4c6c-a879-b227542d5d0d) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: INFO os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:04:52,bridge_name='br-int',has_traffic_filtering=True,id=a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1,network=Network(df6c441e-53c1-4ece-9673-40b37b1f682b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64bd6ed-ab')
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:16:5a,bridge_name='br-int',has_traffic_filtering=True,id=fd56b57e-5bb6-4d2d-9618-4e3f38da11f8,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56b57e-5b') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:16:5a,bridge_name='br-int',has_traffic_filtering=True,id=fd56b57e-5bb6-4d2d-9618-4e3f38da11f8,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56b57e-5b') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd56b57e-5b, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eb0cdd1-685c-4dec-a78d-543837507ce8) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: INFO os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:16:5a,bridge_name='br-int',has_traffic_filtering=True,id=fd56b57e-5bb6-4d2d-9618-4e3f38da11f8,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd56b57e-5b')
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500656982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500656982',id=12,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4+aLmJL3NGQARierTE0ZuzBrCM6pVkXwWIVzmE/tqEiT3U6e9Ga8nVVWjvc0pFwgAZf350hQyD6bKhgBOvRGQ88J/SYes5F/XxfTKGhfZuhUJGvpHtrFENJvjUDgbzVw==',key_name='tempest-keypair-201359591',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b4495aa33c44917bfb5de654e542e57',ramdisk_id='',reservation_id='r-w24dx0wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-35755980',owner_user_name='tempest-TaggedBootDevicesTest-35755980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='863dd2b14fb645b098249136d726ac49',uuid=20efc112-72c3-4d40-ae01-d1e827bc2fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converting VIF {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:4d:8e,bridge_name='br-int',has_traffic_filtering=True,id=9e664875-3ea4-4a54-a7cc-1d24e551117b,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e664875-3e') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4d:8e,bridge_name='br-int',has_traffic_filtering=True,id=9e664875-3ea4-4a54-a7cc-1d24e551117b,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e664875-3e') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e664875-3e, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e02d57f0-8b40-44ce-99ec-bbc0dd34c857) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: INFO os_vif [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:4d:8e,bridge_name='br-int',has_traffic_filtering=True,id=9e664875-3ea4-4a54-a7cc-1d24e551117b,network=Network(faff603a-3bef-404f-9e43-d4e1d799992f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e664875-3e')
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRqOgYro', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[565534ad-327c-4795-a640-603ef387a10f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:09:33 user nova-compute[74534]: No targets found.
Nov 02 12:09:33 user nova-compute[74534]: iSNS:
Nov 02 12:09:33 user nova-compute[74534]: No targets found.
Nov 02 12:09:33 user nova-compute[74534]: STATIC:
Nov 02 12:09:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:09:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:09:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:09:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:09:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17
Nov 02 12:09:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:09:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84
Nov 02 12:09:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:33 user nova-compute[74534]: FIRMWARE:
Nov 02 12:09:33 user nova-compute[74534]: No targets found.
Nov 02 12:09:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:09:33 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:09:33 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1ef160-965d-4f4a-9a20-c0e22bc54204]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db069be-5660-44cc-8905-e28f076564ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:33 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe18034b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84'): ({'sde'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Removing single pathed devices sde {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Updating instance_info_cache with network_info: [{"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[814be1eb-91ff-464c-a09e-e2f1d6bf3363]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec776a2-7988-41e0-95e1-3bec759639be]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Flushing IO for device /dev/sde {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Releasing lock "refresh_cache-516a3fb1-8fcf-400f-851e-ebde11f99928" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Instance network_info: |[{"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] Acquired lock "refresh_cache-516a3fb1-8fcf-400f-851e-ebde11f99928" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.neutron [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Refreshing network info cache for port 1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Start _get_guest_xml network_info=[{"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfbb2fa-0358-4034-8abc-5a4d3413cbe8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:33 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-947350685',display_name='tempest-VolumesActionsTest-instance-947350685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-947350685',id=16,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c632d2880cae4fee92c4b408c9c2aff5',ramdisk_id='',reservation_id='r-erfis13g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-105983395',owner_user_name='tempest-VolumesActionsTest-105983395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:09:30Z,user_data=None,user_id='b9b5a220e5284d76b8a1ee606a2104fb',uuid=516a3fb1-8fcf-400f-851e-ebde11f99928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converting VIF {"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=1c874c94-eb24-43cd-b67c-85e46d133c52,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c874c94-eb') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.objects.instance [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lazy-loading 'pci_devices' on Instance uuid 516a3fb1-8fcf-400f-851e-ebde11f99928 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1ced33-4c53-40da-a547-b175e1711b80]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:09:33 user nova-compute[74534]:   <uuid>516a3fb1-8fcf-400f-851e-ebde11f99928</uuid>
Nov 02 12:09:33 user nova-compute[74534]:   <name>instance-00000010</name>
Nov 02 12:09:33 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:09:33 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:09:33 user nova-compute[74534]:   <metadata>
Nov 02 12:09:33 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:09:33 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:09:33 user nova-compute[74534]:       <nova:name>tempest-VolumesActionsTest-instance-947350685</nova:name>
Nov 02 12:09:33 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:09:33</nova:creationTime>
Nov 02 12:09:33 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:09:33 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:09:33 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:09:33 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:09:33 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:09:33 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:09:33 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:09:33 user nova-compute[74534]:       <nova:owner>
Nov 02 12:09:33 user nova-compute[74534]:         <nova:user uuid="b9b5a220e5284d76b8a1ee606a2104fb">tempest-VolumesActionsTest-105983395-project-member</nova:user>
Nov 02 12:09:33 user nova-compute[74534]:         <nova:project uuid="c632d2880cae4fee92c4b408c9c2aff5">tempest-VolumesActionsTest-105983395</nova:project>
Nov 02 12:09:33 user nova-compute[74534]:       </nova:owner>
Nov 02 12:09:33 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:09:33 user nova-compute[74534]:       <nova:ports>
Nov 02 12:09:33 user nova-compute[74534]:         <nova:port uuid="1c874c94-eb24-43cd-b67c-85e46d133c52">
Nov 02 12:09:33 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:09:33 user nova-compute[74534]:         </nova:port>
Nov 02 12:09:33 user nova-compute[74534]:       </nova:ports>
Nov 02 12:09:33 user nova-compute[74534]:     </nova:instance>
Nov 02 12:09:33 user nova-compute[74534]:   </metadata>
Nov 02 12:09:33 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:09:33 user nova-compute[74534]:     <system>
Nov 02 12:09:33 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:09:33 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:09:33 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:09:33 user nova-compute[74534]:       <entry name="serial">516a3fb1-8fcf-400f-851e-ebde11f99928</entry>
Nov 02 12:09:33 user nova-compute[74534]:       <entry name="uuid">516a3fb1-8fcf-400f-851e-ebde11f99928</entry>
Nov 02 12:09:33 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:09:33 user nova-compute[74534]:     </system>
Nov 02 12:09:33 user nova-compute[74534]:   </sysinfo>
Nov 02 12:09:33 user nova-compute[74534]:   <os>
Nov 02 12:09:33 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:09:33 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:09:33 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:09:33 user nova-compute[74534]:   </os>
Nov 02 12:09:33 user nova-compute[74534]:   <features>
Nov 02 12:09:33 user nova-compute[74534]:     <acpi/>
Nov 02 12:09:33 user nova-compute[74534]:     <apic/>
Nov 02 12:09:33 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:09:33 user nova-compute[74534]:   </features>
Nov 02 12:09:33 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:09:33 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:09:33 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:09:33 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:09:33 user nova-compute[74534]:   </clock>
Nov 02 12:09:33 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:09:33 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:09:33 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:09:33 user nova-compute[74534]:   </cpu>
Nov 02 12:09:33 user nova-compute[74534]:   <devices>
Nov 02 12:09:33 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:09:33 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:09:33 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk"/>
Nov 02 12:09:33 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:09:33 user nova-compute[74534]:     </disk>
Nov 02 12:09:33 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:09:33 user nova-compute[74534]:       <mac address="fa:16:3e:98:4d:03"/>
Nov 02 12:09:33 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:33 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:09:33 user nova-compute[74534]:       <target dev="tap1c874c94-eb"/>
Nov 02 12:09:33 user nova-compute[74534]:     </interface>
Nov 02 12:09:33 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:09:33 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/console.log" append="off"/>
Nov 02 12:09:33 user nova-compute[74534]:     </serial>
Nov 02 12:09:33 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:09:33 user nova-compute[74534]:     <video>
Nov 02 12:09:33 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:33 user nova-compute[74534]:     </video>
Nov 02 12:09:33 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:09:33 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:09:33 user nova-compute[74534]:     </rng>
Nov 02 12:09:33 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:09:33 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:09:33 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:09:33 user nova-compute[74534]:     </memballoon>
Nov 02 12:09:33 user nova-compute[74534]:   </devices>
Nov 02 12:09:33 user nova-compute[74534]: </domain>
Nov 02 12:09:33 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-947350685',display_name='tempest-VolumesActionsTest-instance-947350685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-947350685',id=16,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c632d2880cae4fee92c4b408c9c2aff5',ramdisk_id='',reservation_id='r-erfis13g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-105983395',owner_user_name='tempest-VolumesActionsTest-105983395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:09:30Z,user_data=None,user_id='b9b5a220e5284d76b8a1ee606a2104fb',uuid=516a3fb1-8fcf-400f-851e-ebde11f99928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converting VIF {"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=1c874c94-eb24-43cd-b67c-85e46d133c52,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c874c94-eb') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_vif [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=1c874c94-eb24-43cd-b67c-85e46d133c52,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c874c94-eb') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f97870e0-35c4-561f-ba3d-73a1b1bd6804', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4389904-177c-49e4-8803-ce82ca5ec35d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c874c94-eb, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c874c94-eb, col_values=(('qos', UUID('1f2fc86d-782d-47b8-9101-16cf18d5f0c8')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c874c94-eb, col_values=(('external_ids', {'iface-id': '1c874c94-eb24-43cd-b67c-85e46d133c52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:4d:03', 'vm-uuid': '516a3fb1-8fcf-400f-851e-ebde11f99928'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Releasing lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: INFO os_vif [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=1c874c94-eb24-43cd-b67c-85e46d133c52,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c874c94-eb')
Nov 02 12:09:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance destroyed successfully.
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'resources' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.objects.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:07:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_vif [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f86a40-46, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1f17f3-2f7e-4c28-bcb4-ab4e9551e59a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260]
Nov 02 12:09:34 user nova-compute[74534]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d23cab29-f9db-4009-84b3-4f846b28cab2) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] No VIF found with MAC fa:16:3e:98:4d:03, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:09:34 user nova-compute[74534]: INFO os_vif [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46')
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2913465c-3024-49ec-8348-59aac2a68b84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab19690d-eaf2-44f7-b2ea-ba0ca827b91e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfhdpPuj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:34 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== disconnect_volume: return (523ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYpuGrRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:34 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[68531000-2078-4cc9-ade7-e06cf55e40d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:09:34 user nova-compute[74534]: No targets found.
Nov 02 12:09:34 user nova-compute[74534]: iSNS:
Nov 02 12:09:34 user nova-compute[74534]: No targets found.
Nov 02 12:09:34 user nova-compute[74534]: STATIC:
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: FIRMWARE:
Nov 02 12:09:34 user nova-compute[74534]: No targets found.
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:09:34 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:09:34 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2289ada-bd52-426b-a3f9-430f37e4af49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a1a99c-16b0-4b12-af1b-c7e2e4ea3934]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c7e0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ae6875-7b3b-4735-b670-e4b4e6dcc482]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb2a40c-1509-4732-b4ae-8e7c6fb6070f]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb94be59-58cb-4e76-983f-c325a2b4a44d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.network.neutron [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Updated VIF entry in instance network info cache for port 1c874c94-eb24-43cd-b67c-85e46d133c52. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.network.neutron [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Updating instance_info_cache with network_info: [{"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b649278-96f8-464f-9f2c-835e456c1c99]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2be7f708-1ede-4989-a634-77e87006e918 req-9259cc4a-b2b4-4b99-887f-bc0fdb1ed1fd service nova] Releasing lock "refresh_cache-516a3fb1-8fcf-400f-851e-ebde11f99928" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[409d0d04-0884-4146-93b8-e20dc279f752]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccbc58a-cec1-4c04-aac5-0e77d05e6fa7]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]
Nov 02 12:09:34 user nova-compute[74534]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b79940a-896e-417e-b097-3a9912b82bb6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== disconnect_volume: return (426ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.414s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Start _get_guest_xml network_info=[{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'guest_format': None, 'attachment_id': 'd8b06ce0-6e68-47ef-a460-ba2504722344', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfhdpPuj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ed72d4f3-1405-4e45-8c51-68b6fa57a3c1', 'attached_at': '', 'detached_at': '', 'volume_id': '064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'serial': '064bf791-6451-45fe-bfe3-9c7f85d7c38e'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'numa_topology' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f681ebf3-3a62-47c8-aee3-011d192b0c3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:09:34 user nova-compute[74534]: No targets found.
Nov 02 12:09:34 user nova-compute[74534]: iSNS:
Nov 02 12:09:34 user nova-compute[74534]: No targets found.
Nov 02 12:09:34 user nova-compute[74534]: STATIC:
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:09:34 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:34 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:34 user nova-compute[74534]: FIRMWARE:
Nov 02 12:09:34 user nova-compute[74534]: No targets found.
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:09:34 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:09:34 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG nova.objects.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:34 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:34 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1cb502-0229-4593-8f24-d6f8d550ec5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5972f57c-fb9d-4ce6-bef7-72200204cd16]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:34 user nova-compute[74534]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 (non-flash)
Nov 02 12:09:34 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c7a6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17'): ({'sdg'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Removing single pathed devices sdg {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.319s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[129d2e8f-9a0e-4b94-b6f1-22adcb493f51]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9657fc4-92ef-4f6c-92c2-31aa99492dba]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Flushing IO for device /dev/sdg {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.objects.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfhdpPuj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c06177a-0086-4d2d-9507-b2683a5c3e11]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7b495-5e57-48b7-9c00-00103e53422b]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] SCSI volumes sdg have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd677ebb-c94d-4924-bee6-b1e0b20a7071]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f6ceab-f2ae-48f4-8417-324771c4f71f]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260]
Nov 02 12:09:35 user nova-compute[74534]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c20659e-03f6-4563-b449-5c95dbd99d17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b2b561-f5d9-49af-b1b0-41688432a95c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.732s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== disconnect_volume: return (1146ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.240s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:35 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZehFadf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f3105-48b5-43dd-b0c6-f1418858105e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:09:35 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51f827-f14d-4912-acdf-02dabd2bc4fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e] added
Nov 02 12:09:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b996061-92da-40c0-b4cc-496333948318]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeeedc0-f14c-45bb-8f59-9a97440ce1ff]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfhdpPuj {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfhdpPuj" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0143f65-d5c8-4941-8e3e-fcb1802e64fd]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LfhdpPuj'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d23e3-1afd-4fbb-8e17-ca63674924c8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba99a2-bd49-45e2-b937-8512220cd1bc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85f1278-2a7b-4679-9790-4b2acf794061]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]
Nov 02 12:09:35 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8331a876-bb87-4455-a738-fbceef539cb7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6018e24-bda9-4b82-9ff9-34b41a34a019]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:35 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0d647c-112c-43cc-999c-0709f340d043]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-34d1e249-e3f9-4cf4-a79b-38a7950f09a3 req-3bb69924-45e9-4b06-83d2-38d4be9269f4 service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received event network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-34d1e249-e3f9-4cf4-a79b-38a7950f09a3 req-3bb69924-45e9-4b06-83d2-38d4be9269f4 service nova] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-34d1e249-e3f9-4cf4-a79b-38a7950f09a3 req-3bb69924-45e9-4b06-83d2-38d4be9269f4 service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-34d1e249-e3f9-4cf4-a79b-38a7950f09a3 req-3bb69924-45e9-4b06-83d2-38d4be9269f4 service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-34d1e249-e3f9-4cf4-a79b-38a7950f09a3 req-3bb69924-45e9-4b06-83d2-38d4be9269f4 service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] No waiting events found dispatching network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:35 user nova-compute[74534]: WARNING nova.compute.manager [req-34d1e249-e3f9-4cf4-a79b-38a7950f09a3 req-3bb69924-45e9-4b06-83d2-38d4be9269f4 service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received unexpected event network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 for instance with vm_state building and task_state spawning.
Nov 02 12:09:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfhdpPuj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== connect_volume: return (1641ms) {'type': 'block', 'scsi_wwn': '26534643030636661', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534643030636661', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.380s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:07:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'pci_devices' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fb7506-09ee-41f9-81cf-091b7d5d9288]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:09:36 user nova-compute[74534]: No targets found.
Nov 02 12:09:36 user nova-compute[74534]: iSNS:
Nov 02 12:09:36 user nova-compute[74534]: No targets found.
Nov 02 12:09:36 user nova-compute[74534]: STATIC:
Nov 02 12:09:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:09:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc
Nov 02 12:09:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:09:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:09:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:09:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:09:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:09:36 user nova-compute[74534]: FIRMWARE:
Nov 02 12:09:36 user nova-compute[74534]: No targets found.
Nov 02 12:09:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:09:36 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:09:36 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG nova.objects.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:09:36 user nova-compute[74534]:   <uuid>ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</uuid>
Nov 02 12:09:36 user nova-compute[74534]:   <name>instance-00000004</name>
Nov 02 12:09:36 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:09:36 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:09:36 user nova-compute[74534]:   <metadata>
Nov 02 12:09:36 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:09:36 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:09:36 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeTestJSON-server-884397019</nova:name>
Nov 02 12:09:36 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:09:34</nova:creationTime>
Nov 02 12:09:36 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:09:36 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:09:36 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:09:36 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:09:36 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:09:36 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:09:36 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:09:36 user nova-compute[74534]:       <nova:owner>
Nov 02 12:09:36 user nova-compute[74534]:         <nova:user uuid="4eb3d0118fba4c4eb8edebcb7e68eb93">tempest-AttachVolumeTestJSON-1871374392-project-member</nova:user>
Nov 02 12:09:36 user nova-compute[74534]:         <nova:project uuid="6f40e1ed522748be85c5bdd3b6405652">tempest-AttachVolumeTestJSON-1871374392</nova:project>
Nov 02 12:09:36 user nova-compute[74534]:       </nova:owner>
Nov 02 12:09:36 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:09:36 user nova-compute[74534]:       <nova:ports>
Nov 02 12:09:36 user nova-compute[74534]:         <nova:port uuid="77f86a40-464c-4f30-a11d-abf8b4a7f8d4">
Nov 02 12:09:36 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:09:36 user nova-compute[74534]:         </nova:port>
Nov 02 12:09:36 user nova-compute[74534]:       </nova:ports>
Nov 02 12:09:36 user nova-compute[74534]:     </nova:instance>
Nov 02 12:09:36 user nova-compute[74534]:   </metadata>
Nov 02 12:09:36 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:09:36 user nova-compute[74534]:     <system>
Nov 02 12:09:36 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:09:36 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:09:36 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:09:36 user nova-compute[74534]:       <entry name="serial">ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</entry>
Nov 02 12:09:36 user nova-compute[74534]:       <entry name="uuid">ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</entry>
Nov 02 12:09:36 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:09:36 user nova-compute[74534]:     </system>
Nov 02 12:09:36 user nova-compute[74534]:   </sysinfo>
Nov 02 12:09:36 user nova-compute[74534]:   <os>
Nov 02 12:09:36 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:09:36 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:09:36 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:09:36 user nova-compute[74534]:   </os>
Nov 02 12:09:36 user nova-compute[74534]:   <features>
Nov 02 12:09:36 user nova-compute[74534]:     <acpi/>
Nov 02 12:09:36 user nova-compute[74534]:     <apic/>
Nov 02 12:09:36 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:09:36 user nova-compute[74534]:   </features>
Nov 02 12:09:36 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:09:36 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:09:36 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:09:36 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:09:36 user nova-compute[74534]:   </clock>
Nov 02 12:09:36 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:09:36 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:09:36 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:09:36 user nova-compute[74534]:   </cpu>
Nov 02 12:09:36 user nova-compute[74534]:   <devices>
Nov 02 12:09:36 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:09:36 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:09:36 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk"/>
Nov 02 12:09:36 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:09:36 user nova-compute[74534]:     </disk>
Nov 02 12:09:36 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:09:36 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:09:36 user nova-compute[74534]:       <source dev="/dev/sdc"/>
Nov 02 12:09:36 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:09:36 user nova-compute[74534]:       <serial>064bf791-6451-45fe-bfe3-9c7f85d7c38e</serial>
Nov 02 12:09:36 user nova-compute[74534]:     </disk>
Nov 02 12:09:36 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:09:36 user nova-compute[74534]:       <mac address="fa:16:3e:72:88:5c"/>
Nov 02 12:09:36 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:36 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:09:36 user nova-compute[74534]:       <target dev="tap77f86a40-46"/>
Nov 02 12:09:36 user nova-compute[74534]:     </interface>
Nov 02 12:09:36 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:09:36 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/console.log" append="off"/>
Nov 02 12:09:36 user nova-compute[74534]:     </serial>
Nov 02 12:09:36 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:09:36 user nova-compute[74534]:     <video>
Nov 02 12:09:36 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:36 user nova-compute[74534]:     </video>
Nov 02 12:09:36 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:09:36 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:09:36 user nova-compute[74534]:     </rng>
Nov 02 12:09:36 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:09:36 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:09:36 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:09:36 user nova-compute[74534]:     </memballoon>
Nov 02 12:09:36 user nova-compute[74534]:   </devices>
Nov 02 12:09:36 user nova-compute[74534]: </domain>
Nov 02 12:09:36 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[323adb42-7256-4397-af23-99966e5683ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a6869f-dee6-4fb5-9753-f791f482754e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:36 user nova-compute[74534]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc (non-flash)
Nov 02 12:09:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe18069f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc'): ({'sdf'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Removing single pathed devices sdf {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8870298c-58b4-4837-a69a-226ffbd33de5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d830ff-eec4-45bb-b562-edbfa2a2f3e9]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Flushing IO for device /dev/sdf {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c562b-73c2-461a-ae83-437d58668086]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[608731fb-1a8f-4e86-8003-e53f371811c0]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1746f17c-2d66-49b8-b15f-2adb7d9e8528]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7ca8cc-ce34-4cad-bf4f-e236bbb238a6]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260]
Nov 02 12:09:37 user nova-compute[74534]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc, portal: 172.16.0.220,3260] successful.
Nov 02 12:09:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54361e7-bef3-48c7-9ba9-07f6cc8690bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0d57e0-55a9-4ec5-9897-9e53e63c8f20]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] <== disconnect_volume: return (1884ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:09:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Deleting instance files /opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2_del
Nov 02 12:09:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Deletion of /opt/stack/data/nova/instances/20efc112-72c3-4d40-ae01-d1e827bc2fc2_del complete
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.objects.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:37 user nova-compute[74534]: INFO nova.compute.manager [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Took 7.18 seconds to destroy the instance on the hypervisor.
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.280s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Cannot resize image /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'migration_context' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.objects.base [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:07:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG os_vif [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c6cbe1e-6215-585b-a8b9-cffff15f9e89', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77f86a40-46, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77f86a40-46, col_values=(('qos', UUID('e662c74a-cf66-48d7-9a64-e9f2f3a5ce3c')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77f86a40-46, col_values=(('external_ids', {'iface-id': '77f86a40-464c-4f30-a11d-abf8b4a7f8d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:88:5c', 'vm-uuid': 'ed72d4f3-1405-4e45-8c51-68b6fa57a3c1'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:38 user nova-compute[74534]: INFO os_vif [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46')
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-096637ee-d343-4ab5-86ab-cb43c286ea5f req-e400f48e-537c-46a2-bc86-73906e03443b service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received event network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-096637ee-d343-4ab5-86ab-cb43c286ea5f req-e400f48e-537c-46a2-bc86-73906e03443b service nova] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-096637ee-d343-4ab5-86ab-cb43c286ea5f req-e400f48e-537c-46a2-bc86-73906e03443b service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-096637ee-d343-4ab5-86ab-cb43c286ea5f req-e400f48e-537c-46a2-bc86-73906e03443b service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-096637ee-d343-4ab5-86ab-cb43c286ea5f req-e400f48e-537c-46a2-bc86-73906e03443b service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] No waiting events found dispatching network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:38 user nova-compute[74534]: WARNING nova.compute.manager [req-096637ee-d343-4ab5-86ab-cb43c286ea5f req-e400f48e-537c-46a2-bc86-73906e03443b service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received unexpected event network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 for instance with vm_state building and task_state spawning.
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:09:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Instance spawned successfully.
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:09:38 user nova-compute[74534]: INFO nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Took 8.59 seconds to spawn the instance on the hypervisor.
Nov 02 12:09:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:09:38 user nova-compute[74534]: INFO nova.compute.manager [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Took 9.79 seconds to build instance.
Nov 02 12:09:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fc5354bb-b2e5-42b4-85de-791050a1684e tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.940s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-changed-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Refreshing instance network info cache due to event network-changed-2960630e-2789-4bfd-b46c-f1899ddd68ce. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:09:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] Acquiring lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] Acquired lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:39 user nova-compute[74534]: DEBUG nova.network.neutron [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Refreshing network info cache for port 2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:09:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:40 user nova-compute[74534]: INFO nova.compute.manager [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Terminating instance
Nov 02 12:09:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-5d12c060-916d-4d41-abb1-0a6308b6a6ef req-204278db-2094-44a3-8d13-e4f37ab2733e service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-deleted-dd647ef0-4d20-41aa-96bf-b9e8041c2c86 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:40 user nova-compute[74534]: INFO nova.compute.manager [req-5d12c060-916d-4d41-abb1-0a6308b6a6ef req-204278db-2094-44a3-8d13-e4f37ab2733e service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Neutron deleted interface dd647ef0-4d20-41aa-96bf-b9e8041c2c86; detaching it from the instance and deleting it from the info cache
Nov 02 12:09:40 user nova-compute[74534]: DEBUG nova.network.neutron [req-5d12c060-916d-4d41-abb1-0a6308b6a6ef req-204278db-2094-44a3-8d13-e4f37ab2733e service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [{"id": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "address": "fa:16:3e:40:1d:57", "network": {"id": "3308069e-715c-4071-ad60-f63f247e0dd2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1846975803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63ba33b-30", "ovs_interfaceid": "b63ba33b-30a3-4a5a-ad82-a446542e96a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-5d12c060-916d-4d41-abb1-0a6308b6a6ef req-204278db-2094-44a3-8d13-e4f37ab2733e service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Detach interface failed, port_id=dd647ef0-4d20-41aa-96bf-b9e8041c2c86, reason: Instance 20efc112-72c3-4d40-ae01-d1e827bc2fc2 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG nova.network.neutron [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Updated VIF entry in instance network info cache for port 2960630e-2789-4bfd-b46c-f1899ddd68ce. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:09:40 user nova-compute[74534]: DEBUG nova.network.neutron [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Updating instance_info_cache with network_info: [{"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4150d6f2-3ec8-4dfa-a1be-e7299e0f87cc req-6f3f1d09-3dfb-41e8-a7cc-6352b611671d service nova] Releasing lock "refresh_cache-0be2a397-b69d-46fc-a5c3-5f50f92a6781" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Instance destroyed successfully.
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.objects.instance [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'resources' on Instance uuid 0be2a397-b69d-46fc-a5c3-5f50f92a6781 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-928612153',display_name='tempest-AttachVolumeNegativeTest-server-928612153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-928612153',id=13,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEAE1HrSlVRxXlrVV0IisJm/IKGyMfpRg2SEtVQx4Iow2OpAisvs5sVLMhRqs8Mg3J9v/qfpsPWvRSQ3iVDwSog/iLrVVdXbXHqKchNETw/VE+D4Md1vHGiepuij3TTMA==',key_name='tempest-keypair-1370197256',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:07:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-yyqh6ciq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:07:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=0be2a397-b69d-46fc-a5c3-5f50f92a6781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "address": "fa:16:3e:49:2f:40", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960630e-27", "ovs_interfaceid": "2960630e-2789-4bfd-b46c-f1899ddd68ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:2f:40,bridge_name='br-int',has_traffic_filtering=True,id=2960630e-2789-4bfd-b46c-f1899ddd68ce,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960630e-27') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG os_vif [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2f:40,bridge_name='br-int',has_traffic_filtering=True,id=2960630e-2789-4bfd-b46c-f1899ddd68ce,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960630e-27') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2960630e-27, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f36f232-8814-4cb7-8ac0-2d546691f10c) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:41 user nova-compute[74534]: INFO os_vif [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:2f:40,bridge_name='br-int',has_traffic_filtering=True,id=2960630e-2789-4bfd-b46c-f1899ddd68ce,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960630e-27')
Nov 02 12:09:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Deleting instance files /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781_del
Nov 02 12:09:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Deletion of /opt/stack/data/nova/instances/0be2a397-b69d-46fc-a5c3-5f50f92a6781_del complete
Nov 02 12:09:41 user nova-compute[74534]: INFO nova.compute.manager [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:41 user nova-compute[74534]: WARNING nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state stopped and task_state powering-on.
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:41 user nova-compute[74534]: WARNING nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state stopped and task_state powering-on.
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-vif-unplugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Acquiring lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] No waiting events found dispatching network-vif-unplugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-vif-unplugged-2960630e-2789-4bfd-b46c-f1899ddd68ce for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Acquiring lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] No waiting events found dispatching network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:41 user nova-compute[74534]: WARNING nova.compute.manager [req-53b701e8-0a70-47c8-aef7-3c870cfbd149 req-b1c72883-e2d4-4223-96e7-e60dbc6a1720 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received unexpected event network-vif-plugged-2960630e-2789-4bfd-b46c-f1899ddd68ce for instance with vm_state active and task_state deleting.
Nov 02 12:09:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-d564591e-e91c-4148-8213-aef38c69bb87 req-7512272c-df7d-4f90-ac37-d23510db8174 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-deleted-b63ba33b-30a3-4a5a-ad82-a446542e96a9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:42 user nova-compute[74534]: INFO nova.compute.manager [req-d564591e-e91c-4148-8213-aef38c69bb87 req-7512272c-df7d-4f90-ac37-d23510db8174 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Neutron deleted interface b63ba33b-30a3-4a5a-ad82-a446542e96a9; detaching it from the instance and deleting it from the info cache
Nov 02 12:09:42 user nova-compute[74534]: DEBUG nova.network.neutron [req-d564591e-e91c-4148-8213-aef38c69bb87 req-7512272c-df7d-4f90-ac37-d23510db8174 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [{"id": "23a19e19-7793-45b9-ac52-7948d610d85b", "address": "fa:16:3e:d5:9f:cb", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a19e19-77", "ovs_interfaceid": "23a19e19-7793-45b9-ac52-7948d610d85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "05342184-c439-49b5-b432-825fb8202d12", "address": "fa:16:3e:bd:29:43", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05342184-c4", "ovs_interfaceid": "05342184-c439-49b5-b432-825fb8202d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "address": "fa:16:3e:07:04:52", "network": {"id": "df6c441e-53c1-4ece-9673-40b37b1f682b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1025156734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64bd6ed-ab", "ovs_interfaceid": "a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "address": "fa:16:3e:7b:16:5a", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd56b57e-5b", "ovs_interfaceid": "fd56b57e-5bb6-4d2d-9618-4e3f38da11f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "address": "fa:16:3e:af:4d:8e", "network": {"id": "faff603a-3bef-404f-9e43-d4e1d799992f", "bridge": "br-int", "label": "tempest-device-tagging-net2-2074362416", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b4495aa33c44917bfb5de654e542e57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e664875-3e", "ovs_interfaceid": "9e664875-3ea4-4a54-a7cc-1d24e551117b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-d564591e-e91c-4148-8213-aef38c69bb87 req-7512272c-df7d-4f90-ac37-d23510db8174 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Detach interface failed, port_id=b63ba33b-30a3-4a5a-ad82-a446542e96a9, reason: Instance 20efc112-72c3-4d40-ae01-d1e827bc2fc2 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:09:42 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:42 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Took 1.43 seconds to deallocate network for instance.
Nov 02 12:09:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:09:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance rebooted successfully.
Nov 02 12:09:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-473dfc40-2fa1-475b-8c36-b685b177956d tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:09:43 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:43 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:43 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Deleted allocations for instance 0be2a397-b69d-46fc-a5c3-5f50f92a6781
Nov 02 12:09:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8bd-0136-44ed-ab2a-dc5c11483957 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "0be2a397-b69d-46fc-a5c3-5f50f92a6781" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.333s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:43 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:43 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Took 6.57 seconds to deallocate network for instance.
Nov 02 12:09:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-8bf4fa71-0c84-45be-8d4b-eba7ced96834 req-c96deb8b-1a7f-4d7f-93bc-dd806719c7d1 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-deleted-fd56b57e-5bb6-4d2d-9618-4e3f38da11f8 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-8bf4fa71-0c84-45be-8d4b-eba7ced96834 req-c96deb8b-1a7f-4d7f-93bc-dd806719c7d1 service nova] [instance: 0be2a397-b69d-46fc-a5c3-5f50f92a6781] Received event network-vif-deleted-2960630e-2789-4bfd-b46c-f1899ddd68ce {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-8bf4fa71-0c84-45be-8d4b-eba7ced96834 req-c96deb8b-1a7f-4d7f-93bc-dd806719c7d1 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-deleted-a64bd6ed-ab66-47aa-bf23-2fb3eb6594d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-8bf4fa71-0c84-45be-8d4b-eba7ced96834 req-c96deb8b-1a7f-4d7f-93bc-dd806719c7d1 service nova] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Received event network-vif-deleted-9e664875-3ea4-4a54-a7cc-1d24e551117b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:47 user nova-compute[74534]: INFO nova.compute.manager [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] [instance: 20efc112-72c3-4d40-ae01-d1e827bc2fc2] Took 3.24 seconds to detach 3 volumes for instance.
Nov 02 12:09:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.volume.cinder [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Update attachment failed for attachment 4611cdbf-d68f-48de-b7e2-08b372bec414. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-796a2245-023d-4df2-9976-55264c7a4b13) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-796a2245-023d-4df2-9976-55264c7a4b13)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-796a2245-023d-4df2-9976-55264c7a4b13)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Traceback (most recent call last):
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/compute/manager.py", line 10845, in _error_out_instance_on_exception
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     yield
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     network_info = self._finish_resize(context, instance, migration,
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     self._update_volume_attachments(context, instance, bdms)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     self.volume_api.attachment_update(
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     res = method(self, ctx, *args, **kwargs)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     with excutils.save_and_reraise_exception():
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     self.force_reraise()
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     raise self.value
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     return method.func(obj, *args, **kwargs)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     resp = self._update('/attachments/%s' % id, body)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     return self.request(url, method, **kwargs)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76]     raise exceptions.from_response(resp, body)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-796a2245-023d-4df2-9976-55264c7a4b13)
Nov 02 12:09:47 user nova-compute[74534]: ERROR nova.compute.manager [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] 
Nov 02 12:09:47 user nova-compute[74534]: INFO nova.compute.manager [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Nov 02 12:09:47 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:47 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:47 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Deleted allocation for migration 2c0b9eaf-3742-413d-b0f9-e06585c5c923
Nov 02 12:09:47 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Deleted allocations for instance 20efc112-72c3-4d40-ae01-d1e827bc2fc2
Nov 02 12:09:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-edc7d7fa-5442-46ff-ba52-a4dc3286a61f tempest-TaggedBootDevicesTest-35755980 tempest-TaggedBootDevicesTest-35755980-project-member] Lock "20efc112-72c3-4d40-ae01-d1e827bc2fc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.886s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:48 user nova-compute[74534]: INFO nova.compute.manager [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Rescuing
Nov 02 12:09:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:48 user nova-compute[74534]: INFO nova.compute.manager [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Successfully reverted task state from resize_finish on failure for instance.
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server [None req-33a24a45-25c4-4002-b52b-ea16281be6a1 tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-796a2245-023d-4df2-9976-55264c7a4b13)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6347, in finish_resize
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6344, in finish_resize
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-796a2245-023d-4df2-9976-55264c7a4b13)
Nov 02 12:09:48 user nova-compute[74534]: ERROR oslo_messaging.rpc.server 
Nov 02 12:09:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating instance_info_cache with network_info: [{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:09:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-86e1b2fc-565b-485d-8a5a-504bf66fe5d0 req-aafa2fb0-921c-40ec-8845-0941076ba14c service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-86e1b2fc-565b-485d-8a5a-504bf66fe5d0 req-aafa2fb0-921c-40ec-8845-0941076ba14c service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-86e1b2fc-565b-485d-8a5a-504bf66fe5d0 req-aafa2fb0-921c-40ec-8845-0941076ba14c service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-86e1b2fc-565b-485d-8a5a-504bf66fe5d0 req-aafa2fb0-921c-40ec-8845-0941076ba14c service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-86e1b2fc-565b-485d-8a5a-504bf66fe5d0 req-aafa2fb0-921c-40ec-8845-0941076ba14c service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:49 user nova-compute[74534]: WARNING nova.compute.manager [req-86e1b2fc-565b-485d-8a5a-504bf66fe5d0 req-aafa2fb0-921c-40ec-8845-0941076ba14c service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:49 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance destroyed successfully.
Nov 02 12:09:49 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Attempting a stable device rescue
Nov 02 12:09:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74534) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance directory exists: not creating {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 12:09:49 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Creating image(s)
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "/opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG nova.objects.instance [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'trusted_certs' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "a98f13137c6de628babdcea1f0a232f1105432d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "a98f13137c6de628babdcea1f0a232f1105432d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-1e2a1cd0-32d9-4481-83a8-2c98f2d6d1c2 req-b223d052-ffdc-442e-9b3c-37e8d3e68370 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1e2a1cd0-32d9-4481-83a8-2c98f2d6d1c2 req-b223d052-ffdc-442e-9b3c-37e8d3e68370 service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1e2a1cd0-32d9-4481-83a8-2c98f2d6d1c2 req-b223d052-ffdc-442e-9b3c-37e8d3e68370 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1e2a1cd0-32d9-4481-83a8-2c98f2d6d1c2 req-b223d052-ffdc-442e-9b3c-37e8d3e68370 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-1e2a1cd0-32d9-4481-83a8-2c98f2d6d1c2 req-b223d052-ffdc-442e-9b3c-37e8d3e68370 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:51 user nova-compute[74534]: WARNING nova.compute.manager [req-1e2a1cd0-32d9-4481-83a8-2c98f2d6d1c2 req-b223d052-ffdc-442e-9b3c-37e8d3e68370 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.part --force-share --output=json" returned: 0 in 0.246s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG nova.virt.images [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] d958a4ef-20f8-45cf-b48b-da27b343f69e was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:09:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.part /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.part /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.converted" returned: 0 in 0.296s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0.converted --force-share --output=json" returned: 0 in 0.244s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "a98f13137c6de628babdcea1f0a232f1105432d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.350s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "a98f13137c6de628babdcea1f0a232f1105432d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "a98f13137c6de628babdcea1f0a232f1105432d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0 --force-share --output=json" returned: 0 in 0.273s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0,backing_fmt=raw /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0,backing_fmt=raw /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue" returned: 0 in 0.056s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "a98f13137c6de628babdcea1f0a232f1105432d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'migration_context' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<45b47223-abde-4927-8ad3-1389fed70985> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Start _get_guest_xml network_info=[{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "vif_mac": "fa:16:3e:8c:d2:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd958a4ef-20f8-45cf-b48b-da27b343f69e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': '1283d266-73f3-45c2-ac25-31241db01759', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeNhFBDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '45b47223-abde-4927-8ad3-1389fed70985', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7b84838-380c-4c07-860b-c1c4229c9dd6', 'serial': 'c7b84838-380c-4c07-860b-c1c4229c9dd6'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'resources' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<45b47223-abde-4927-8ad3-1389fed70985> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'numa_topology' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<45b47223-abde-4927-8ad3-1389fed70985> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:52 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:52 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'vcpu_model' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.objects.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<45b47223-abde-4927-8ad3-1389fed70985> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeNhFBDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:09:52 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:52 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:09:52 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[04216908-56e7-42d1-9084-62eb98447e32]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HeNhFBDq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 12:09:52 user nova-compute[74534]: node.name = iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:09:52 user nova-compute[74534]: node.tpgt = -1
Nov 02 12:09:52 user nova-compute[74534]: node.startup = automatic
Nov 02 12:09:52 user nova-compute[74534]: node.leading_login = No
Nov 02 12:09:52 user nova-compute[74534]: iface.iscsi_ifacename = default
Nov 02 12:09:52 user nova-compute[74534]: iface.net_ifacename = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.ipaddress = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.prefix_len = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.hwaddress = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.transport_name = tcp
Nov 02 12:09:52 user nova-compute[74534]: iface.initiatorname = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.state = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.vlan_id = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.vlan_priority = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.vlan_state = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.iface_num = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.mtu = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.port = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.bootproto = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.subnet_mask = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.gateway = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_alt_client_id = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_dns = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_learn_iqn = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_vendor_id_state = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_vendor_id = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.dhcp_slp_da = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.fragmentation = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.gratuitous_arp = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.incoming_forwarding = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.tos_state = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.tos = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.ttl = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.delayed_ack = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.tcp_nagle = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.tcp_wsf_state = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.tcp_wsf = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.tcp_timer_scale = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.tcp_timestamp = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.redirect = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.def_task_mgmt_timeout = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.header_digest = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.data_digest = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.immediate_data = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.initial_r2t = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.data_seq_inorder = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.data_pdu_inorder = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.erl = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.max_receive_data_len = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.first_burst_len = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.max_outstanding_r2t = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.max_burst_len = 0
Nov 02 12:09:52 user nova-compute[74534]: iface.chap_auth = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.bidi_chap = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.strict_login_compliance = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.discovery_auth = <empty>
Nov 02 12:09:52 user nova-compute[74534]: iface.discovery_logout = <empty>
Nov 02 12:09:52 user nova-compute[74534]: node.discovery_address = <empty>
Nov 02 12:09:52 user nova-compute[74534]: node.discovery_port = 0
Nov 02 12:09:52 user nova-compute[74534]: node.discovery_type = static
Nov 02 12:09:52 user nova-compute[74534]: node.session.initial_cmdsn = 0
Nov 02 12:09:52 user nova-compute[74534]: node.session.initial_login_retry_max = 8
Nov 02 12:09:52 user nova-compute[74534]: node.session.xmit_thread_priority = -20
Nov 02 12:09:52 user nova-compute[74534]: node.session.cmds_max = 128
Nov 02 12:09:52 user nova-compute[74534]: node.session.queue_depth = 32
Nov 02 12:09:52 user nova-compute[74534]: node.session.nr_sessions = 1
Nov 02 12:09:52 user nova-compute[74534]: node.session.auth.authmethod = CHAP
Nov 02 12:09:52 user nova-compute[74534]: node.session.auth.username = HeNhFBDq
Nov 02 12:09:52 user nova-compute[74534]: node.session.auth.password = ***
Nov 02 12:09:52 user nova-compute[74534]: node.session.auth.username_in = <empty>
Nov 02 12:09:52 user nova-compute[74534]: node.session.auth.password_in = <empty>
Nov 02 12:09:52 user nova-compute[74534]: node.session.auth.chap_algs = MD5
Nov 02 12:09:52 user nova-compute[74534]: node.session.timeo.replacement_timeout = 120
Nov 02 12:09:52 user nova-compute[74534]: node.session.err_timeo.abort_timeout = 15
Nov 02 12:09:52 user nova-compute[74534]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 12:09:52 user nova-compute[74534]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 12:09:52 user nova-compute[74534]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.FastAbort = Yes
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.InitialR2T = No
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.ImmediateData = Yes
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.MaxConnections = 1
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 12:09:52 user nova-compute[74534]: node.session.iscsi.ERL = 0
Nov 02 12:09:52 user nova-compute[74534]: node.session.scan = manual
Nov 02 12:09:52 user nova-compute[74534]: node.session.reopen_max = 0
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].address = 172.16.0.220
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].port = 3260
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].startup = manual
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].tcp.window_size = 524288
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].tcp.type_of_service = 0
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].timeo.logout_timeout = 15
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].timeo.login_timeout = 15
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].timeo.auth_timeout = 45
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].iscsi.DataDigest = None
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].iscsi.IFMarker = No
Nov 02 12:09:52 user nova-compute[74534]: node.conn[0].iscsi.OFMarker = No
Nov 02 12:09:52 user nova-compute[74534]: # END RECORD
Nov 02 12:09:52 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3bc3c7-23e4-4a4a-b096-d6008198de95]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb7621b-065e-47dd-8ceb-d1c7bd698490]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeNhFBDq {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeNhFBDq" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75293bd-e358-4008-a197-689948b1b46c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HeNhFBDq'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc1193-ea12-4c43-af8f-75bfa51b19a7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b614953-f65c-49cb-845e-93faa704f04d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:53 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:53 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:09:53 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:09:53 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:09:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:09:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.200s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] HCTL ('35', '0', '0', 0) found on session 11 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c4f258-e231-42d2-95d1-542bd1a8b269]: (4, ('0 0 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching for a device in session 11 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeNhFBDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.237s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== connect_volume: return (239ms) {'type': 'block', 'scsi_wwn': '26461313130303834', 'path': '/dev/sdd'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461313130303834', 'path': '/dev/sdd'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322581251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322581251',id=14,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-dg7alpnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:08:42Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=45b47223-abde-4927-8ad3-1389fed70985,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "vif_mac": "fa:16:3e:8c:d2:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "vif_mac": "fa:16:3e:8c:d2:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.objects.instance [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'pci_devices' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.objects.base [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<45b47223-abde-4927-8ad3-1389fed70985> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:09:53 user nova-compute[74534]:   <uuid>45b47223-abde-4927-8ad3-1389fed70985</uuid>
Nov 02 12:09:53 user nova-compute[74534]:   <name>instance-0000000e</name>
Nov 02 12:09:53 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:09:53 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:09:53 user nova-compute[74534]:   <metadata>
Nov 02 12:09:53 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:09:53 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:09:53 user nova-compute[74534]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1322581251</nova:name>
Nov 02 12:09:53 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:09:52</nova:creationTime>
Nov 02 12:09:53 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:09:53 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:09:53 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:09:53 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:09:53 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:09:53 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:09:53 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:09:53 user nova-compute[74534]:       <nova:owner>
Nov 02 12:09:53 user nova-compute[74534]:         <nova:user uuid="caf5cde0e75e444da00c7bcda4bcdd28">tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member</nova:user>
Nov 02 12:09:53 user nova-compute[74534]:         <nova:project uuid="25ccb20fcd184ecebd3707d9d93c8817">tempest-ServerBootFromVolumeStableRescueTest-1363504210</nova:project>
Nov 02 12:09:53 user nova-compute[74534]:       </nova:owner>
Nov 02 12:09:53 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:09:53 user nova-compute[74534]:       <nova:ports>
Nov 02 12:09:53 user nova-compute[74534]:         <nova:port uuid="7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5">
Nov 02 12:09:53 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 12:09:53 user nova-compute[74534]:         </nova:port>
Nov 02 12:09:53 user nova-compute[74534]:       </nova:ports>
Nov 02 12:09:53 user nova-compute[74534]:     </nova:instance>
Nov 02 12:09:53 user nova-compute[74534]:   </metadata>
Nov 02 12:09:53 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:09:53 user nova-compute[74534]:     <system>
Nov 02 12:09:53 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:09:53 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:09:53 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:09:53 user nova-compute[74534]:       <entry name="serial">45b47223-abde-4927-8ad3-1389fed70985</entry>
Nov 02 12:09:53 user nova-compute[74534]:       <entry name="uuid">45b47223-abde-4927-8ad3-1389fed70985</entry>
Nov 02 12:09:53 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:09:53 user nova-compute[74534]:     </system>
Nov 02 12:09:53 user nova-compute[74534]:   </sysinfo>
Nov 02 12:09:53 user nova-compute[74534]:   <os>
Nov 02 12:09:53 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:09:53 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:09:53 user nova-compute[74534]:   </os>
Nov 02 12:09:53 user nova-compute[74534]:   <features>
Nov 02 12:09:53 user nova-compute[74534]:     <acpi/>
Nov 02 12:09:53 user nova-compute[74534]:     <apic/>
Nov 02 12:09:53 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:09:53 user nova-compute[74534]:   </features>
Nov 02 12:09:53 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:09:53 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:09:53 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:09:53 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:09:53 user nova-compute[74534]:   </clock>
Nov 02 12:09:53 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:09:53 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:09:53 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:09:53 user nova-compute[74534]:   </cpu>
Nov 02 12:09:53 user nova-compute[74534]:   <devices>
Nov 02 12:09:53 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:09:53 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:09:53 user nova-compute[74534]:       <source dev="/dev/sdd"/>
Nov 02 12:09:53 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:09:53 user nova-compute[74534]:       <serial>c7b84838-380c-4c07-860b-c1c4229c9dd6</serial>
Nov 02 12:09:53 user nova-compute[74534]:     </disk>
Nov 02 12:09:53 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:09:53 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:09:53 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue"/>
Nov 02 12:09:53 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:09:53 user nova-compute[74534]:       <boot order="1"/>
Nov 02 12:09:53 user nova-compute[74534]:     </disk>
Nov 02 12:09:53 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:09:53 user nova-compute[74534]:       <mac address="fa:16:3e:8c:d2:d9"/>
Nov 02 12:09:53 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:53 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:09:53 user nova-compute[74534]:       <target dev="tap7dc3f134-1a"/>
Nov 02 12:09:53 user nova-compute[74534]:     </interface>
Nov 02 12:09:53 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:09:53 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/console.log" append="off"/>
Nov 02 12:09:53 user nova-compute[74534]:     </serial>
Nov 02 12:09:53 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:09:53 user nova-compute[74534]:     <video>
Nov 02 12:09:53 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:09:53 user nova-compute[74534]:     </video>
Nov 02 12:09:53 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:09:53 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:09:53 user nova-compute[74534]:     </rng>
Nov 02 12:09:53 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:09:53 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:09:53 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:09:53 user nova-compute[74534]:     </memballoon>
Nov 02 12:09:53 user nova-compute[74534]:   </devices>
Nov 02 12:09:53 user nova-compute[74534]: </domain>
Nov 02 12:09:53 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:09:53 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance destroyed successfully.
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:09:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No VIF found with MAC fa:16:3e:8c:d2:d9, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:09:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-40883a45-91fa-421b-8232-4f1b53d481a3 req-8dc43f2c-bd98-43f5-a268-d4c39a3865c2 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-40883a45-91fa-421b-8232-4f1b53d481a3 req-8dc43f2c-bd98-43f5-a268-d4c39a3865c2 service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-40883a45-91fa-421b-8232-4f1b53d481a3 req-8dc43f2c-bd98-43f5-a268-d4c39a3865c2 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-40883a45-91fa-421b-8232-4f1b53d481a3 req-8dc43f2c-bd98-43f5-a268-d4c39a3865c2 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-40883a45-91fa-421b-8232-4f1b53d481a3 req-8dc43f2c-bd98-43f5-a268-d4c39a3865c2 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:55 user nova-compute[74534]: WARNING nova.compute.manager [req-40883a45-91fa-421b-8232-4f1b53d481a3 req-8dc43f2c-bd98-43f5-a268-d4c39a3865c2 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-a41634b0-dace-4e95-b9f2-455dad3cb189 req-4821ba99-ab3f-4277-81ba-9addea04013b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:09:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a41634b0-dace-4e95-b9f2-455dad3cb189 req-4821ba99-ab3f-4277-81ba-9addea04013b service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:09:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a41634b0-dace-4e95-b9f2-455dad3cb189 req-4821ba99-ab3f-4277-81ba-9addea04013b service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:09:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a41634b0-dace-4e95-b9f2-455dad3cb189 req-4821ba99-ab3f-4277-81ba-9addea04013b service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:09:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-a41634b0-dace-4e95-b9f2-455dad3cb189 req-4821ba99-ab3f-4277-81ba-9addea04013b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:09:57 user nova-compute[74534]: WARNING nova.compute.manager [req-a41634b0-dace-4e95-b9f2-455dad3cb189 req-4821ba99-ab3f-4277-81ba-9addea04013b service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state active and task_state rescuing.
Nov 02 12:09:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-add49a01-731b-45ee-8ff4-ff71064dca13 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:09:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:09:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:10:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:10:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:10:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:10:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7606MB free_disk=25.208541870117188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Applying migration context for instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 as it has an incoming, in-progress migration 2c0b9eaf-3742-413d-b0f9-e06585c5c923. Migration status is error {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74534) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 516a3fb1-8fcf-400f-851e-ebde11f99928 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:10:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:10:20 user nova-compute[74534]: INFO nova.compute.claims [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Claim successful on node user
Nov 02 12:10:20 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:10:20 user nova-compute[74534]: DEBUG nova.network.neutron [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:10:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:10:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG nova.policy [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '229100ec64ca41c29e10777e20031198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4d9a8ef7434eb9838bd0cf15f8c25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:10:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Creating image(s)
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "/opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "/opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "/opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk 1073741824" returned: 0 in 0.062s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG nova.network.neutron [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Successfully created port: 21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.224s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:10:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Cannot resize image /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Ensure instance console log exists: /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Successfully updated port: 21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquired lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-changed-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Refreshing instance network info cache due to event network-changed-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] Acquiring lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updating instance_info_cache with network_info: [{"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Releasing lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Instance network_info: |[{"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] Acquired lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Refreshing network info cache for port 21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Start _get_guest_xml network_info=[{"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:10:22 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:10:22 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:10:22 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1433026891',display_name='tempest-TestVolumeSwap-server-1433026891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1433026891',id=17,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuGHy77k7thjYtCg5qXrYtEYyznFMi83dyWxz6YRtbByMlq6lCUDtIKDSbEjzHwnqokwXBmSbWqI/naWm4K/lkktg0zUdoVHw+MC+C3oRgCDr57cphWNeS+mGIeUwPrKw==',key_name='tempest-keypair-1671246879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d9a8ef7434eb9838bd0cf15f8c25b',ramdisk_id='',reservation_id='r-ou6a08x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1825163514',owner_user_name='tempest-TestVolumeSwap-1825163514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229100ec64ca41c29e10777e20031198',uuid=68f79d06-363a-44d0-a74a-4c745558f0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Converting VIF {"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92,network=Network(9d10b72f-bedd-4548-a6ce-b68d9964c427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21a2de97-57') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lazy-loading 'pci_devices' on Instance uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:10:23 user nova-compute[74534]:   <uuid>68f79d06-363a-44d0-a74a-4c745558f0ea</uuid>
Nov 02 12:10:23 user nova-compute[74534]:   <name>instance-00000011</name>
Nov 02 12:10:23 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:10:23 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:10:23 user nova-compute[74534]:   <metadata>
Nov 02 12:10:23 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:10:23 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:10:23 user nova-compute[74534]:       <nova:name>tempest-TestVolumeSwap-server-1433026891</nova:name>
Nov 02 12:10:23 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:10:22</nova:creationTime>
Nov 02 12:10:23 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:10:23 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:10:23 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:10:23 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:10:23 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:10:23 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:10:23 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:10:23 user nova-compute[74534]:       <nova:owner>
Nov 02 12:10:23 user nova-compute[74534]:         <nova:user uuid="229100ec64ca41c29e10777e20031198">tempest-TestVolumeSwap-1825163514-project-member</nova:user>
Nov 02 12:10:23 user nova-compute[74534]:         <nova:project uuid="7c4d9a8ef7434eb9838bd0cf15f8c25b">tempest-TestVolumeSwap-1825163514</nova:project>
Nov 02 12:10:23 user nova-compute[74534]:       </nova:owner>
Nov 02 12:10:23 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:10:23 user nova-compute[74534]:       <nova:ports>
Nov 02 12:10:23 user nova-compute[74534]:         <nova:port uuid="21a2de97-57de-4c7e-ac4d-0d91cc3fcd92">
Nov 02 12:10:23 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 12:10:23 user nova-compute[74534]:         </nova:port>
Nov 02 12:10:23 user nova-compute[74534]:       </nova:ports>
Nov 02 12:10:23 user nova-compute[74534]:     </nova:instance>
Nov 02 12:10:23 user nova-compute[74534]:   </metadata>
Nov 02 12:10:23 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:10:23 user nova-compute[74534]:     <system>
Nov 02 12:10:23 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:10:23 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:10:23 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:10:23 user nova-compute[74534]:       <entry name="serial">68f79d06-363a-44d0-a74a-4c745558f0ea</entry>
Nov 02 12:10:23 user nova-compute[74534]:       <entry name="uuid">68f79d06-363a-44d0-a74a-4c745558f0ea</entry>
Nov 02 12:10:23 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:10:23 user nova-compute[74534]:     </system>
Nov 02 12:10:23 user nova-compute[74534]:   </sysinfo>
Nov 02 12:10:23 user nova-compute[74534]:   <os>
Nov 02 12:10:23 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:10:23 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:10:23 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:10:23 user nova-compute[74534]:   </os>
Nov 02 12:10:23 user nova-compute[74534]:   <features>
Nov 02 12:10:23 user nova-compute[74534]:     <acpi/>
Nov 02 12:10:23 user nova-compute[74534]:     <apic/>
Nov 02 12:10:23 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:10:23 user nova-compute[74534]:   </features>
Nov 02 12:10:23 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:10:23 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:10:23 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:10:23 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:10:23 user nova-compute[74534]:   </clock>
Nov 02 12:10:23 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:10:23 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:10:23 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:10:23 user nova-compute[74534]:   </cpu>
Nov 02 12:10:23 user nova-compute[74534]:   <devices>
Nov 02 12:10:23 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:10:23 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:10:23 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk"/>
Nov 02 12:10:23 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:10:23 user nova-compute[74534]:     </disk>
Nov 02 12:10:23 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:10:23 user nova-compute[74534]:       <mac address="fa:16:3e:e9:ab:e7"/>
Nov 02 12:10:23 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:10:23 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:10:23 user nova-compute[74534]:       <target dev="tap21a2de97-57"/>
Nov 02 12:10:23 user nova-compute[74534]:     </interface>
Nov 02 12:10:23 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:10:23 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/console.log" append="off"/>
Nov 02 12:10:23 user nova-compute[74534]:     </serial>
Nov 02 12:10:23 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:10:23 user nova-compute[74534]:     <video>
Nov 02 12:10:23 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:10:23 user nova-compute[74534]:     </video>
Nov 02 12:10:23 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:10:23 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:10:23 user nova-compute[74534]:     </rng>
Nov 02 12:10:23 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:10:23 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:10:23 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:10:23 user nova-compute[74534]:     </memballoon>
Nov 02 12:10:23 user nova-compute[74534]:   </devices>
Nov 02 12:10:23 user nova-compute[74534]: </domain>
Nov 02 12:10:23 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1433026891',display_name='tempest-TestVolumeSwap-server-1433026891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1433026891',id=17,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuGHy77k7thjYtCg5qXrYtEYyznFMi83dyWxz6YRtbByMlq6lCUDtIKDSbEjzHwnqokwXBmSbWqI/naWm4K/lkktg0zUdoVHw+MC+C3oRgCDr57cphWNeS+mGIeUwPrKw==',key_name='tempest-keypair-1671246879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4d9a8ef7434eb9838bd0cf15f8c25b',ramdisk_id='',reservation_id='r-ou6a08x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1825163514',owner_user_name='tempest-TestVolumeSwap-1825163514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229100ec64ca41c29e10777e20031198',uuid=68f79d06-363a-44d0-a74a-4c745558f0ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Converting VIF {"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92,network=Network(9d10b72f-bedd-4548-a6ce-b68d9964c427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21a2de97-57') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG os_vif [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92,network=Network(9d10b72f-bedd-4548-a6ce-b68d9964c427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21a2de97-57') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa98b343-9493-5e6e-8f08-3774201ef494', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21a2de97-57, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21a2de97-57, col_values=(('qos', UUID('442f47b3-d23e-4b36-902c-d92049b04d35')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21a2de97-57, col_values=(('external_ids', {'iface-id': '21a2de97-57de-4c7e-ac4d-0d91cc3fcd92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:ab:e7', 'vm-uuid': '68f79d06-363a-44d0-a74a-4c745558f0ea'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:23 user nova-compute[74534]: INFO os_vif [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92,network=Network(9d10b72f-bedd-4548-a6ce-b68d9964c427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21a2de97-57')
Nov 02 12:10:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] No VIF found with MAC fa:16:3e:e9:ab:e7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updated VIF entry in instance network info cache for port 21a2de97-57de-4c7e-ac4d-0d91cc3fcd92. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updating instance_info_cache with network_info: [{"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:10:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5636e59-c20d-40e3-8727-766bfdad0127 req-89b097ef-4889-4ce4-b828-aff059fa55e5 service nova] Releasing lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:10:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-c054f6d0-1f72-4230-8633-0483a867434f req-4dd80525-804d-4860-ac3f-b75612011f12 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c054f6d0-1f72-4230-8633-0483a867434f req-4dd80525-804d-4860-ac3f-b75612011f12 service nova] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c054f6d0-1f72-4230-8633-0483a867434f req-4dd80525-804d-4860-ac3f-b75612011f12 service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c054f6d0-1f72-4230-8633-0483a867434f req-4dd80525-804d-4860-ac3f-b75612011f12 service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-c054f6d0-1f72-4230-8633-0483a867434f req-4dd80525-804d-4860-ac3f-b75612011f12 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] No waiting events found dispatching network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:10:25 user nova-compute[74534]: WARNING nova.compute.manager [req-c054f6d0-1f72-4230-8633-0483a867434f req-4dd80525-804d-4860-ac3f-b75612011f12 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received unexpected event network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 for instance with vm_state building and task_state spawning.
Nov 02 12:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-afb7b0fc-dbd9-40d4-86fb-847cddc39356 req-689079f4-fe48-4ada-9b59-25b79147320f service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-afb7b0fc-dbd9-40d4-86fb-847cddc39356 req-689079f4-fe48-4ada-9b59-25b79147320f service nova] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-afb7b0fc-dbd9-40d4-86fb-847cddc39356 req-689079f4-fe48-4ada-9b59-25b79147320f service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-afb7b0fc-dbd9-40d4-86fb-847cddc39356 req-689079f4-fe48-4ada-9b59-25b79147320f service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-afb7b0fc-dbd9-40d4-86fb-847cddc39356 req-689079f4-fe48-4ada-9b59-25b79147320f service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] No waiting events found dispatching network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:10:27 user nova-compute[74534]: WARNING nova.compute.manager [req-afb7b0fc-dbd9-40d4-86fb-847cddc39356 req-689079f4-fe48-4ada-9b59-25b79147320f service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received unexpected event network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 for instance with vm_state building and task_state spawning.
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:10:27 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Instance spawned successfully.
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:27 user nova-compute[74534]: INFO nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 02 12:10:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:10:27 user nova-compute[74534]: INFO nova.compute.manager [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Took 7.52 seconds to build instance.
Nov 02 12:10:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88760d2b-89a6-43c6-a78c-d54152ad0c47 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.635s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:33 user nova-compute[74534]: INFO nova.compute.manager [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Detaching volume eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:10:33 user nova-compute[74534]: INFO nova.virt.block_device [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Attempting to driver detach volume eb252b9d-8711-44a0-92d6-717fe4120b5f from mountpoint /dev/vdb
Nov 02 12:10:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Attempting to detach device vdb from instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:10:33 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:10:33 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:10:33 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:10:33 user nova-compute[74534]:   <serial>eb252b9d-8711-44a0-92d6-717fe4120b5f</serial>
Nov 02 12:10:33 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:10:33 user nova-compute[74534]: </disk>
Nov 02 12:10:33 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:10:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully detached device vdb from instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 from the persistent domain config.
Nov 02 12:10:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:10:33 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:10:33 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:10:33 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:10:33 user nova-compute[74534]:   <serial>eb252b9d-8711-44a0-92d6-717fe4120b5f</serial>
Nov 02 12:10:33 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:10:33 user nova-compute[74534]: </disk>
Nov 02 12:10:33 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:10:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:10:40 user nova-compute[74534]: INFO nova.compute.claims [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Claim successful on node user
Nov 02 12:10:40 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:10:40 user nova-compute[74534]: DEBUG nova.network.neutron [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:10:40 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:10:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Creating image(s)
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "/opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "/opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "/opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.policy [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a71588ab6ed4d93aa359a76cbc9f7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb39968885c2474e97da3a7e426c0e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk 1073741824" returned: 0 in 0.076s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Cannot resize image /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Ensure instance console log exists: /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:42 user nova-compute[74534]: DEBUG nova.network.neutron [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Successfully created port: 1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-changed-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Refreshing instance network info cache due to event network-changed-df1e966f-35ba-4e1e-b92b-e35ba3d79b61. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] Acquiring lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] Acquired lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG nova.network.neutron [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Refreshing network info cache for port df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:43 user nova-compute[74534]: DEBUG nova.objects.instance [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'flavor' on Instance uuid 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:44 user nova-compute[74534]: INFO nova.compute.manager [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Attaching volume 63b6a609-c704-4b97-99c0-03babdd70321 to /dev/vdb
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updated VIF entry in instance network info cache for port df1e966f-35ba-4e1e-b92b-e35ba3d79b61. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updating instance_info_cache with network_info: [{"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d0aa1209-0ba2-477f-8ce9-c65e39839930 req-2f822004-e038-4685-9a73-ca9e93163e30 service nova] Releasing lock "refresh_cache-530fbde9-c0cf-4f20-9b7c-b91296394e2e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG os_brick.utils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53087b-91be-495a-a73a-b65ec47c1e28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e528ffbf-5cbd-4b96-88c7-c0c1e51fb13c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d6dd8-281b-4f83-afe7-fb54deb2b065]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbe83cf-d474-401c-916d-97962c6bc85a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Successfully updated port: 1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-changed-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Refreshing instance network info cache due to event network-changed-1f4bee35-a830-4a42-bd66-801b00ae8d73. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] Acquiring lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] Acquired lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Refreshing network info cache for port 1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:10:44 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[426f8286-bfe9-4331-b5ad-db27ed35b965]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG os_brick.utils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updating existing volume attachment record: 706d06bf-a60d-4afe-b73a-9241555a4879 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-74231db2-752d-4397-b036-8277f0c0e1fb req-4572cc47-58f9-4ac5-b545-bff7601fd3b4 service nova] Releasing lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquired lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:10:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.network.neutron [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updating instance_info_cache with network_info: [{"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Releasing lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Instance network_info: |[{"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Start _get_guest_xml network_info=[{"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:10:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:10:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:10:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1567822340',display_name='tempest-VolumesAdminNegativeTest-server-1567822340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1567822340',id=18,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV5H7xvv80UoY0TFeniEVk5VOPBY+xcVSH/kZcB0++IfuXj6/q0y761CpMi3XDSbyvGIdsUJYfRKtHj4QfjeQHnLF/3uIJdrFQPXlt9ROkclpv3GNb+lpKdRQNIqg2IXA==',key_name='tempest-keypair-1708377516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb39968885c2474e97da3a7e426c0e17',ramdisk_id='',reservation_id='r-dg0d4v9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1124753556',owner_user_name='tempest-VolumesAdminNegativeTest-1124753556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a71588ab6ed4d93aa359a76cbc9f7ac',uuid=e20af21c-b63b-4fd2-b4f3-8ca800894ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converting VIF {"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=1f4bee35-a830-4a42-bd66-801b00ae8d73,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4bee35-a8') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.objects.instance [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lazy-loading 'pci_devices' on Instance uuid e20af21c-b63b-4fd2-b4f3-8ca800894ea9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:10:46 user nova-compute[74534]:   <uuid>e20af21c-b63b-4fd2-b4f3-8ca800894ea9</uuid>
Nov 02 12:10:46 user nova-compute[74534]:   <name>instance-00000012</name>
Nov 02 12:10:46 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:10:46 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:10:46 user nova-compute[74534]:   <metadata>
Nov 02 12:10:46 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:10:46 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:10:46 user nova-compute[74534]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1567822340</nova:name>
Nov 02 12:10:46 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:10:45</nova:creationTime>
Nov 02 12:10:46 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:10:46 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:10:46 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:10:46 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:10:46 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:10:46 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:10:46 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:10:46 user nova-compute[74534]:       <nova:owner>
Nov 02 12:10:46 user nova-compute[74534]:         <nova:user uuid="2a71588ab6ed4d93aa359a76cbc9f7ac">tempest-VolumesAdminNegativeTest-1124753556-project-member</nova:user>
Nov 02 12:10:46 user nova-compute[74534]:         <nova:project uuid="bb39968885c2474e97da3a7e426c0e17">tempest-VolumesAdminNegativeTest-1124753556</nova:project>
Nov 02 12:10:46 user nova-compute[74534]:       </nova:owner>
Nov 02 12:10:46 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:10:46 user nova-compute[74534]:       <nova:ports>
Nov 02 12:10:46 user nova-compute[74534]:         <nova:port uuid="1f4bee35-a830-4a42-bd66-801b00ae8d73">
Nov 02 12:10:46 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 12:10:46 user nova-compute[74534]:         </nova:port>
Nov 02 12:10:46 user nova-compute[74534]:       </nova:ports>
Nov 02 12:10:46 user nova-compute[74534]:     </nova:instance>
Nov 02 12:10:46 user nova-compute[74534]:   </metadata>
Nov 02 12:10:46 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:10:46 user nova-compute[74534]:     <system>
Nov 02 12:10:46 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:10:46 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:10:46 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:10:46 user nova-compute[74534]:       <entry name="serial">e20af21c-b63b-4fd2-b4f3-8ca800894ea9</entry>
Nov 02 12:10:46 user nova-compute[74534]:       <entry name="uuid">e20af21c-b63b-4fd2-b4f3-8ca800894ea9</entry>
Nov 02 12:10:46 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:10:46 user nova-compute[74534]:     </system>
Nov 02 12:10:46 user nova-compute[74534]:   </sysinfo>
Nov 02 12:10:46 user nova-compute[74534]:   <os>
Nov 02 12:10:46 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:10:46 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:10:46 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:10:46 user nova-compute[74534]:   </os>
Nov 02 12:10:46 user nova-compute[74534]:   <features>
Nov 02 12:10:46 user nova-compute[74534]:     <acpi/>
Nov 02 12:10:46 user nova-compute[74534]:     <apic/>
Nov 02 12:10:46 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:10:46 user nova-compute[74534]:   </features>
Nov 02 12:10:46 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:10:46 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:10:46 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:10:46 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:10:46 user nova-compute[74534]:   </clock>
Nov 02 12:10:46 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:10:46 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:10:46 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:10:46 user nova-compute[74534]:   </cpu>
Nov 02 12:10:46 user nova-compute[74534]:   <devices>
Nov 02 12:10:46 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:10:46 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:10:46 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk"/>
Nov 02 12:10:46 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:10:46 user nova-compute[74534]:     </disk>
Nov 02 12:10:46 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:10:46 user nova-compute[74534]:       <mac address="fa:16:3e:f9:54:3d"/>
Nov 02 12:10:46 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:10:46 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:10:46 user nova-compute[74534]:       <target dev="tap1f4bee35-a8"/>
Nov 02 12:10:46 user nova-compute[74534]:     </interface>
Nov 02 12:10:46 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:10:46 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/console.log" append="off"/>
Nov 02 12:10:46 user nova-compute[74534]:     </serial>
Nov 02 12:10:46 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:10:46 user nova-compute[74534]:     <video>
Nov 02 12:10:46 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:10:46 user nova-compute[74534]:     </video>
Nov 02 12:10:46 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:10:46 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:10:46 user nova-compute[74534]:     </rng>
Nov 02 12:10:46 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:10:46 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:10:46 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:10:46 user nova-compute[74534]:     </memballoon>
Nov 02 12:10:46 user nova-compute[74534]:   </devices>
Nov 02 12:10:46 user nova-compute[74534]: </domain>
Nov 02 12:10:46 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1567822340',display_name='tempest-VolumesAdminNegativeTest-server-1567822340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1567822340',id=18,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV5H7xvv80UoY0TFeniEVk5VOPBY+xcVSH/kZcB0++IfuXj6/q0y761CpMi3XDSbyvGIdsUJYfRKtHj4QfjeQHnLF/3uIJdrFQPXlt9ROkclpv3GNb+lpKdRQNIqg2IXA==',key_name='tempest-keypair-1708377516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb39968885c2474e97da3a7e426c0e17',ramdisk_id='',reservation_id='r-dg0d4v9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1124753556',owner_user_name='tempest-VolumesAdminNegativeTest-1124753556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a71588ab6ed4d93aa359a76cbc9f7ac',uuid=e20af21c-b63b-4fd2-b4f3-8ca800894ea9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converting VIF {"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=1f4bee35-a830-4a42-bd66-801b00ae8d73,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4bee35-a8') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG os_vif [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=1f4bee35-a830-4a42-bd66-801b00ae8d73,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4bee35-a8') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29f1fe32-df05-51db-ad35-1d25df3b164f', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4bee35-a8, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f4bee35-a8, col_values=(('qos', UUID('42312792-8a70-46c2-b8ff-e003d3d6bc79')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f4bee35-a8, col_values=(('external_ids', {'iface-id': '1f4bee35-a830-4a42-bd66-801b00ae8d73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:54:3d', 'vm-uuid': 'e20af21c-b63b-4fd2-b4f3-8ca800894ea9'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:46 user nova-compute[74534]: INFO os_vif [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=1f4bee35-a830-4a42-bd66-801b00ae8d73,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4bee35-a8')
Nov 02 12:10:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:10:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] No VIF found with MAC fa:16:3e:f9:54:3d, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-48fbb95e-3f51-4dad-adab-c76b95bd86e0 req-8f39ab39-9bc1-44a0-8338-857f891ad315 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48fbb95e-3f51-4dad-adab-c76b95bd86e0 req-8f39ab39-9bc1-44a0-8338-857f891ad315 service nova] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48fbb95e-3f51-4dad-adab-c76b95bd86e0 req-8f39ab39-9bc1-44a0-8338-857f891ad315 service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48fbb95e-3f51-4dad-adab-c76b95bd86e0 req-8f39ab39-9bc1-44a0-8338-857f891ad315 service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-48fbb95e-3f51-4dad-adab-c76b95bd86e0 req-8f39ab39-9bc1-44a0-8338-857f891ad315 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] No waiting events found dispatching network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:10:47 user nova-compute[74534]: WARNING nova.compute.manager [req-48fbb95e-3f51-4dad-adab-c76b95bd86e0 req-8f39ab39-9bc1-44a0-8338-857f891ad315 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received unexpected event network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 for instance with vm_state building and task_state spawning.
Nov 02 12:10:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1e60f9d-ceb6-4bdd-a46d-a6aff7113068 req-62a4b0ec-61ad-4fa7-ab71-1f5bc9c8d50a service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:10:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1e60f9d-ceb6-4bdd-a46d-a6aff7113068 req-62a4b0ec-61ad-4fa7-ab71-1f5bc9c8d50a service nova] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:10:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1e60f9d-ceb6-4bdd-a46d-a6aff7113068 req-62a4b0ec-61ad-4fa7-ab71-1f5bc9c8d50a service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:10:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1e60f9d-ceb6-4bdd-a46d-a6aff7113068 req-62a4b0ec-61ad-4fa7-ab71-1f5bc9c8d50a service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1e60f9d-ceb6-4bdd-a46d-a6aff7113068 req-62a4b0ec-61ad-4fa7-ab71-1f5bc9c8d50a service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] No waiting events found dispatching network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:10:49 user nova-compute[74534]: WARNING nova.compute.manager [req-a1e60f9d-ceb6-4bdd-a46d-a6aff7113068 req-62a4b0ec-61ad-4fa7-ab71-1f5bc9c8d50a service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received unexpected event network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 for instance with vm_state building and task_state spawning.
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:10:50 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Instance spawned successfully.
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:10:50 user nova-compute[74534]: INFO nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Took 9.05 seconds to spawn the instance on the hypervisor.
Nov 02 12:10:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:10:50 user nova-compute[74534]: INFO nova.compute.manager [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Took 9.96 seconds to build instance.
Nov 02 12:10:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-437bb65f-9ef3-46cd-b002-6deaf4e63b10 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.064s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:10:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:53 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 is timed out.
Nov 02 12:10:53 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully detached device vdb from instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 from the live domain config.
Nov 02 12:10:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFIloVBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:10:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d53b2e-658b-4514-9ec1-209629f6b4c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:10:53 user nova-compute[74534]: No targets found.
Nov 02 12:10:53 user nova-compute[74534]: iSNS:
Nov 02 12:10:53 user nova-compute[74534]: No targets found.
Nov 02 12:10:53 user nova-compute[74534]: STATIC:
Nov 02 12:10:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:10:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:10:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:10:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f
Nov 02 12:10:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:10:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:10:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:10:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:10:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:10:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:10:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:10:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:10:53 user nova-compute[74534]: FIRMWARE:
Nov 02 12:10:53 user nova-compute[74534]: No targets found.
Nov 02 12:10:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:10:53 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:10:53 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a633196e-6b1f-4d72-9063-7d081b74fca7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5f863-56ad-4bf4-99a7-347873cad4b0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:10:53 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:10:53 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:10:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:10:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:10:53 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:10:53 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:10:53 user nova-compute[74534]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f (non-flash)
Nov 02 12:10:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1804243a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:10:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9494f0a2-248d-4119-8532-4e84bcdb1fcf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aeded2-b659-4894-89a5-3303ed267f49]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7e0833-53a2-45a3-b3f1-080172f7543e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[942042aa-d0e4-479a-90b7-fdeca3fe01a3]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b653c05b-2d4a-44b0-981a-7069986cddfa]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a83ed06-adc8-4d12-8227-28cf89aa605c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260]
Nov 02 12:10:54 user nova-compute[74534]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f, portal: 172.16.0.220,3260] successful.
Nov 02 12:10:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb252b9d-8711-44a0-92d6-717fe4120b5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4805bcb-d65e-44e0-9e76-cdf2544a63a7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== disconnect_volume: return (369ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:10:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:10:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:10:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:10:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:10:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:00 user nova-compute[74534]: INFO nova.compute.manager [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Terminating instance
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:11:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance destroyed successfully.
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lazy-loading 'resources' on Instance uuid 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2130605991',display_name='tempest-ServerActionsTestOtherB-server-2130605991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2130605991',id=3,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyXevzzyGgg4+GaKM5XRqX2ueUd/PMUbZw4+E9/82E2Xdqds5ls0nogBKehj5TA3RwtugaQqFt5VCxoMw1V4Q2Y1sw8BfaMErazKbOIIAiJ2DZFBh8oNzVRdHN+0rybZw==',key_name='tempest-keypair-1958950750',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c253a7a30a6841c0a231f30d9da9b66c',ramdisk_id='',reservation_id='r-9fi998ul',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1657074801',owner_user_name='tempest-ServerActionsTestOtherB-1657074801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:09:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e63b6c90e2784a209a5a7300b985f47c',uuid=603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converting VIF {"id": "6bd2394c-d906-4662-a101-dc05b7f71de0", "address": "fa:16:3e:b6:67:db", "network": {"id": "ff5b7616-a79a-43d7-bca8-e8bab27d602b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-736870664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c253a7a30a6841c0a231f30d9da9b66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd2394c-d9", "ovs_interfaceid": "6bd2394c-d906-4662-a101-dc05b7f71de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_vif [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bd2394c-d9, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:11:00 user nova-compute[74534]: INFO os_vif [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:67:db,bridge_name='br-int',has_traffic_filtering=True,id=6bd2394c-d906-4662-a101-dc05b7f71de0,network=Network(ff5b7616-a79a-43d7-bca8-e8bab27d602b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd2394c-d9')
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xiXQPFDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:00 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a441ed-8d49-435b-9c76-5ad11baa2336]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:11:00 user nova-compute[74534]: No targets found.
Nov 02 12:11:00 user nova-compute[74534]: iSNS:
Nov 02 12:11:00 user nova-compute[74534]: No targets found.
Nov 02 12:11:00 user nova-compute[74534]: STATIC:
Nov 02 12:11:00 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:11:00 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:00 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:00 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:11:00 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:00 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:00 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:11:00 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:00 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:00 user nova-compute[74534]: FIRMWARE:
Nov 02 12:11:00 user nova-compute[74534]: No targets found.
Nov 02 12:11:00 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:11:00 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:11:00 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6decd5c3-0e06-47f4-990f-3dc007ec3d7a', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4356e5-30f0-4ecd-bc89-8d02b14ecfa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06980f-d559-4680-8785-68f0ce812bdd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:00 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:00 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:00 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:00 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:00 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:00 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c64c280>, {}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Disconnecting from: [] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] <== disconnect_volume: return (93ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:11:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Deletion of /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize failed
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:01 user nova-compute[74534]: INFO nova.compute.manager [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Took 0.31 seconds to destroy the instance on the hypervisor.
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:01 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-47793831-6aa0-465d-b0ca-fa970541813d req-105ccc76-807b-43db-ac22-9298eae22879 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Received event network-vif-deleted-6bd2394c-d906-4662-a101-dc05b7f71de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:02 user nova-compute[74534]: INFO nova.compute.manager [req-47793831-6aa0-465d-b0ca-fa970541813d req-105ccc76-807b-43db-ac22-9298eae22879 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Neutron deleted interface 6bd2394c-d906-4662-a101-dc05b7f71de0; detaching it from the instance and deleting it from the info cache
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.network.neutron [req-47793831-6aa0-465d-b0ca-fa970541813d req-105ccc76-807b-43db-ac22-9298eae22879 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:02 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Took 0.98 seconds to deallocate network for instance.
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-47793831-6aa0-465d-b0ca-fa970541813d req-105ccc76-807b-43db-ac22-9298eae22879 service nova] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Detach interface failed, port_id=6bd2394c-d906-4662-a101-dc05b7f71de0, reason: Instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:02 user nova-compute[74534]: INFO nova.compute.manager [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Took 0.34 seconds to detach 1 volumes for instance.
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:11:02 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:03 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Error from libvirt while getting description of instance-00000003: [Error Code 42] Domain not found: no domain with matching uuid '603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76' (instance-00000003): libvirt.libvirtError: Domain not found: no domain with matching uuid '603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76' (instance-00000003)
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.007s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:03 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Deleted allocations for instance 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7bbefecd-9705-45d5-9600-58e8eacec0af tempest-ServerActionsTestOtherB-1657074801 tempest-ServerActionsTestOtherB-1657074801-project-member] Lock "603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.130s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:05 user nova-compute[74534]: DEBUG nova.objects.instance [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6a15ecc3-5ef8-4724-8cde-a1419c9e6cec tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.035s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7370MB free_disk=25.156841278076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 516a3fb1-8fcf-400f-851e-ebde11f99928 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 68f79d06-363a-44d0-a74a-4c745558f0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:11:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 1 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:11:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Deletion of /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize failed
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:07 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:07 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:07 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ed820-74b3-4c0f-9937-a1210dab40fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:11:07 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[82adfb3d-8eee-49a0-a1d7-1e4d715fad77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321] added
Nov 02 12:11:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:11:07 user nova-compute[74534]: INFO nova.compute.claims [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Claim successful on node user
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa2158-97ce-472e-b1bd-a812f8d45234]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7a767-d3ac-43ed-92a7-15fa43e92b88]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FibhWnwe {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FibhWnwe" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e9461b-0606-4b68-9c68-3ad8d6bc43c5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FibhWnwe'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6356cd2d-0214-447e-8188-2ef35d7e9409]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7377dac-c904-45a2-a515-2c13b35064b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f849717f-7c50-46e0-8b8f-1bc6208ca9a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]
Nov 02 12:11:07 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.
Nov 02 12:11:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[81584346-eb94-4341-a36c-6dd4edf643b7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:07 user nova-compute[74534]: INFO nova.compute.manager [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Unrescuing
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea054766-e92b-4e9a-b735-349d04f52f21]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:07 user nova-compute[74534]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd1e9ff-08b6-4e30-a84b-d43a1d36e481]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:11:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:11:08 user nova-compute[74534]: INFO nova.virt.block_device [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Booting with volume 23064b31-3e27-4c42-85d0-0cc2fe4ba016 at /dev/vda
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.policy [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3db2c5117c754142978c7a872de22fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd863bade99ab4f4e946637975a0f7224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.utils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc5d7ad-be95-4cf9-bb50-b1a5f8f0f82a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72ea50-09ee-4e45-96b9-6173379a6f73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fc4cbf-1d11-4e52-993c-e8f3d43955b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1093916-bb33-4ced-be2a-e2a82857aec3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.objects.instance [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'flavor' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:11:08 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe9fe90-3d21-4bb1-997f-c051ead3c3f8]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.utils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updating existing volume attachment record: 68acf395-0203-4627-bf00-6920490d58f3 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23865306239313238', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865306239313238', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.objects.instance [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'flavor' on Instance uuid 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:11:08 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:08 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:11:08 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:11:08 user nova-compute[74534]:   <serial>63b6a609-c704-4b97-99c0-03babdd70321</serial>
Nov 02 12:11:08 user nova-compute[74534]: </disk>
Nov 02 12:11:08 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-a498e02b-6ebc-4416-a726-454a1ed77970 req-78d487db-0a3f-412f-868c-df34f3fbc822 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a498e02b-6ebc-4416-a726-454a1ed77970 req-78d487db-0a3f-412f-868c-df34f3fbc822 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a498e02b-6ebc-4416-a726-454a1ed77970 req-78d487db-0a3f-412f-868c-df34f3fbc822 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a498e02b-6ebc-4416-a726-454a1ed77970 req-78d487db-0a3f-412f-868c-df34f3fbc822 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-a498e02b-6ebc-4416-a726-454a1ed77970 req-78d487db-0a3f-412f-868c-df34f3fbc822 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:08 user nova-compute[74534]: WARNING nova.compute.manager [req-a498e02b-6ebc-4416-a726-454a1ed77970 req-78d487db-0a3f-412f-868c-df34f3fbc822 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing instance network info cache due to event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:08 user nova-compute[74534]: DEBUG nova.network.neutron [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:11:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:11:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:11:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No VIF found with MAC fa:16:3e:b9:fb:c9, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:11:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Successfully created port: 3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:11:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:09 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance destroyed successfully.
Nov 02 12:11:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f3f4b326-9c09-4c96-8e30-ad50a0d6a45f tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.662s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updated VIF entry in instance network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f0c59a57-f507-49f0-92f1-9f4c6a9c5fc3 req-fba23ebe-1502-460e-ab4e-03e6255b41ad service nova] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Successfully updated port: 3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquired lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-changed-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Refreshing instance network info cache due to event network-changed-3704c8b5-ecf1-441a-8c0e-9219f2e12835. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] Acquiring lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:11:10 user nova-compute[74534]: INFO nova.compute.manager [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Rebuilding instance
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-36531ccd-d0d4-492a-b79b-6640e5c23f83 req-965ac872-d3cf-4a88-91aa-52777df376c7 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36531ccd-d0d4-492a-b79b-6640e5c23f83 req-965ac872-d3cf-4a88-91aa-52777df376c7 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36531ccd-d0d4-492a-b79b-6640e5c23f83 req-965ac872-d3cf-4a88-91aa-52777df376c7 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36531ccd-d0d4-492a-b79b-6640e5c23f83 req-965ac872-d3cf-4a88-91aa-52777df376c7 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-36531ccd-d0d4-492a-b79b-6640e5c23f83 req-965ac872-d3cf-4a88-91aa-52777df376c7 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:10 user nova-compute[74534]: WARNING nova.compute.manager [req-36531ccd-d0d4-492a-b79b-6640e5c23f83 req-965ac872-d3cf-4a88-91aa-52777df376c7 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing instance network info cache due to event network-changed-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] Acquiring lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] Acquired lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Refreshing network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG nova.network.neutron [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updating instance_info_cache with network_info: [{"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Releasing lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance network_info: |[{"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] Acquired lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Refreshing network info cache for port 3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:11:12 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance destroyed successfully.
Nov 02 12:11:12 user nova-compute[74534]: INFO nova.compute.manager [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Detaching volume 63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:11:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updated VIF entry in instance network info cache for port e87382cc-9797-48c4-b9b7-eaf7c1d85ea2. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [{"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e0467cec-358b-486b-bb09-33874c78a036 req-5d4603ec-928e-47e4-8b12-41c14944ae88 service nova] Releasing lock "refresh_cache-c7d59af9-1ab5-43b4-84af-3a27cd182e29" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:12 user nova-compute[74534]: INFO nova.virt.block_device [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Attempting to driver detach volume 63b6a609-c704-4b97-99c0-03babdd70321 from mountpoint /dev/vdb
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Attempting to detach device vdb from instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:11:12 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:12 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:11:12 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:11:12 user nova-compute[74534]:   <serial>63b6a609-c704-4b97-99c0-03babdd70321</serial>
Nov 02 12:11:12 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:11:12 user nova-compute[74534]: </disk>
Nov 02 12:11:12 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:11:12 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully detached device vdb from instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e from the persistent domain config.
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:12 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af33742-19c4-49be-b056-e8ed77e4370e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:11:12 user nova-compute[74534]: No targets found.
Nov 02 12:11:12 user nova-compute[74534]: iSNS:
Nov 02 12:11:12 user nova-compute[74534]: No targets found.
Nov 02 12:11:12 user nova-compute[74534]: STATIC:
Nov 02 12:11:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:11:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:11:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:11:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:12 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:11:12 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:12 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:12 user nova-compute[74534]: FIRMWARE:
Nov 02 12:11:12 user nova-compute[74534]: No targets found.
Nov 02 12:11:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:11:12 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:11:12 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[433ca9f8-0e60-4e0a-942e-c1df871443a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b1ec6-574f-468f-bbb4-3b6da617b1c8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:12 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:12 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:12 user nova-compute[74534]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:12 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:12 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:12 user nova-compute[74534]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1a33ee290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[44918ac0-1b04-478b-8004-eb51574b8055]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updated VIF entry in instance network info cache for port 3704c8b5-ecf1-441a-8c0e-9219f2e12835. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updating instance_info_cache with network_info: [{"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-684fa211-744c-483e-aa94-7a38d28bef28 req-da2177fa-9248-4a3a-8242-3982c06e6956 service nova] Releasing lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb5d156-0f41-4ec5-8b23-04740733e481]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea2a5cd-5bc5-4d8f-8680-df6e42ac0322]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dd81b6-8524-4be1-8f9c-8a4585fda9ba]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1c3a08-b6c2-459d-8928-4b80638e823f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d98aefa-1ea9-4afa-8623-088f2d580045]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]
Nov 02 12:11:12 user nova-compute[74534]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.
Nov 02 12:11:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aedaf3c-7b6d-4ace-98a4-1fb5b05e934a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== disconnect_volume: return (339ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-unplugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-unplugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:13 user nova-compute[74534]: WARNING nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received unexpected event network-vif-unplugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with vm_state active and task_state rebuilding.
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:13 user nova-compute[74534]: WARNING nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received unexpected event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with vm_state active and task_state rebuilding.
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:13 user nova-compute[74534]: WARNING nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:13 user nova-compute[74534]: WARNING nova.compute.manager [req-9c2d61c3-1d12-4ed4-93e9-170721addfd3 req-aa13e319-605c-4095-b542-aa19ae41151c service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance destroyed successfully.
Nov 02 12:11:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-494432744',display_name='tempest-ServerActionsTestOtherA-server-998874074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-494432744',id=15,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0Er+iV0JuqGua4bxljSzid6e+SBjxx22nRQ+h73MhbqL5/talrrpwV6bPTgkxz82FgRzDTXzhYgQCd6uha9SECrsSRu7T8feWG69VkQgQbXnJ9BhWbbsv4PIJhs9P1cg==',key_name='tempest-keypair-2079383095',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-g4t4y7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=530fbde9-c0cf-4f20-9b7c-b91296394e2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_vif [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf1e966f-35, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d6f6dfa-54f6-41ee-9b58-9e8b94bfa9e4) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:14 user nova-compute[74534]: INFO os_vif [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35')
Nov 02 12:11:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:14 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd19cef-e446-4f33-bef7-d03f51170057]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:11:14 user nova-compute[74534]: No targets found.
Nov 02 12:11:14 user nova-compute[74534]: iSNS:
Nov 02 12:11:14 user nova-compute[74534]: No targets found.
Nov 02 12:11:14 user nova-compute[74534]: STATIC:
Nov 02 12:11:14 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:11:14 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:14 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:14 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:11:14 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:14 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:14 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:11:14 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:14 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:14 user nova-compute[74534]: FIRMWARE:
Nov 02 12:11:14 user nova-compute[74534]: No targets found.
Nov 02 12:11:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:11:14 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:11:14 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[458a19b0-bd8b-4d35-a8bf-9c5afbd5c9ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c937d2d-58d2-4133-87ca-21f4e4fb1c54]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:14 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:14 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:14 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:14 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c7a6170>, {}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Disconnecting from: [] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== disconnect_volume: return (77ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:11:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Deleting instance files /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e_del
Nov 02 12:11:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Deletion of /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e_del complete
Nov 02 12:11:14 user nova-compute[74534]: INFO nova.virt.block_device [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Booting with volume 63b6a609-c704-4b97-99c0-03babdd70321 at /dev/vdb
Nov 02 12:11:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4393eb9e-e818-4eed-96a6-1431a53a505f tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3faae-4342-46fc-be6e-11a5b883827f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c69b78-f2c1-4f27-92fc-22ece35ebcae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7417aab9-67d7-441d-8d00-b6fc9fecf729]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0d221-8c08-46a0-a9ec-c2f715252f98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:11:14 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:11:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5300595d-d075-4105-90df-427e1297e0f7]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:14 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updating existing volume attachment record: 8173d66a-71d6-4c18-92a6-943dc42f5484 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:11:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:20 user nova-compute[74534]: INFO nova.compute.manager [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Terminating instance
Nov 02 12:11:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-19db9f69-ba28-44fb-997a-e604a9ea2bf5 req-795124b3-14ed-47b7-a729-d7cbcd3a10c1 service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received event network-vif-unplugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-19db9f69-ba28-44fb-997a-e604a9ea2bf5 req-795124b3-14ed-47b7-a729-d7cbcd3a10c1 service nova] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-19db9f69-ba28-44fb-997a-e604a9ea2bf5 req-795124b3-14ed-47b7-a729-d7cbcd3a10c1 service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-19db9f69-ba28-44fb-997a-e604a9ea2bf5 req-795124b3-14ed-47b7-a729-d7cbcd3a10c1 service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-19db9f69-ba28-44fb-997a-e604a9ea2bf5 req-795124b3-14ed-47b7-a729-d7cbcd3a10c1 service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] No waiting events found dispatching network-vif-unplugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-19db9f69-ba28-44fb-997a-e604a9ea2bf5 req-795124b3-14ed-47b7-a729-d7cbcd3a10c1 service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received event network-vif-unplugged-1c874c94-eb24-43cd-b67c-85e46d133c52 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Instance destroyed successfully.
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lazy-loading 'resources' on Instance uuid 516a3fb1-8fcf-400f-851e-ebde11f99928 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-947350685',display_name='tempest-VolumesActionsTest-instance-947350685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-947350685',id=16,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c632d2880cae4fee92c4b408c9c2aff5',ramdisk_id='',reservation_id='r-erfis13g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-105983395',owner_user_name='tempest-VolumesActionsTest-105983395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:09:39Z,user_data=None,user_id='b9b5a220e5284d76b8a1ee606a2104fb',uuid=516a3fb1-8fcf-400f-851e-ebde11f99928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converting VIF {"id": "1c874c94-eb24-43cd-b67c-85e46d133c52", "address": "fa:16:3e:98:4d:03", "network": {"id": "b34f839a-9941-47f2-8bc3-24d14d65d483", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1100903998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c632d2880cae4fee92c4b408c9c2aff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c874c94-eb", "ovs_interfaceid": "1c874c94-eb24-43cd-b67c-85e46d133c52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=1c874c94-eb24-43cd-b67c-85e46d133c52,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c874c94-eb') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG os_vif [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=1c874c94-eb24-43cd-b67c-85e46d133c52,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c874c94-eb') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c874c94-eb, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f2fc86d-782d-47b8-9101-16cf18d5f0c8) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:21 user nova-compute[74534]: INFO os_vif [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:4d:03,bridge_name='br-int',has_traffic_filtering=True,id=1c874c94-eb24-43cd-b67c-85e46d133c52,network=Network(b34f839a-9941-47f2-8bc3-24d14d65d483),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c874c94-eb')
Nov 02 12:11:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Deleting instance files /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928_del
Nov 02 12:11:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Deletion of /opt/stack/data/nova/instances/516a3fb1-8fcf-400f-851e-ebde11f99928_del complete
Nov 02 12:11:21 user nova-compute[74534]: WARNING nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 3390f6a1-9306-42a3-af5a-b26e113c0b08 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid d4876f34-2e47-4d28-994d-1c6c0338b850 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 516a3fb1-8fcf-400f-851e-ebde11f99928 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid e20af21c-b63b-4fd2-b4f3-8ca800894ea9 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid a9159e85-6d12-4166-be94-8f8b1620761a {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "45b47223-abde-4927-8ad3-1389fed70985" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:21 user nova-compute[74534]: INFO nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: INFO nova.compute.manager [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "45b47223-abde-4927-8ad3-1389fed70985" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:21 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:21 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Took 0.55 seconds to deallocate network for instance.
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:22 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Deleted allocations for instance 516a3fb1-8fcf-400f-851e-ebde11f99928
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27696abf-df2b-489a-a723-357b89dbfefa tempest-VolumesActionsTest-105983395 tempest-VolumesActionsTest-105983395-project-member] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.300s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.355s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:22 user nova-compute[74534]: INFO nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b9b80a66-7b8d-44da-bf7e-c6a04460a577 req-b11de216-8f0c-4c51-a0d1-01940d9892ff service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received event network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b9b80a66-7b8d-44da-bf7e-c6a04460a577 req-b11de216-8f0c-4c51-a0d1-01940d9892ff service nova] Acquiring lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b9b80a66-7b8d-44da-bf7e-c6a04460a577 req-b11de216-8f0c-4c51-a0d1-01940d9892ff service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b9b80a66-7b8d-44da-bf7e-c6a04460a577 req-b11de216-8f0c-4c51-a0d1-01940d9892ff service nova] Lock "516a3fb1-8fcf-400f-851e-ebde11f99928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b9b80a66-7b8d-44da-bf7e-c6a04460a577 req-b11de216-8f0c-4c51-a0d1-01940d9892ff service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] No waiting events found dispatching network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:22 user nova-compute[74534]: WARNING nova.compute.manager [req-b9b80a66-7b8d-44da-bf7e-c6a04460a577 req-b11de216-8f0c-4c51-a0d1-01940d9892ff service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received unexpected event network-vif-plugged-1c874c94-eb24-43cd-b67c-85e46d133c52 for instance with vm_state deleted and task_state None.
Nov 02 12:11:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b9b80a66-7b8d-44da-bf7e-c6a04460a577 req-b11de216-8f0c-4c51-a0d1-01940d9892ff service nova] [instance: 516a3fb1-8fcf-400f-851e-ebde11f99928] Received event network-vif-deleted-1c874c94-eb24-43cd-b67c-85e46d133c52 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:23 user nova-compute[74534]: INFO nova.compute.manager [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Terminating instance
Nov 02 12:11:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:24 user nova-compute[74534]: INFO nova.compute.manager [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Detaching volume 064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:11:24 user nova-compute[74534]: INFO nova.virt.block_device [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Attempting to driver detach volume 064bf791-6451-45fe-bfe3-9c7f85d7c38e from mountpoint /dev/vdb
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Attempting to detach device vdb from instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:11:24 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:24 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:11:24 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:11:24 user nova-compute[74534]:   <serial>064bf791-6451-45fe-bfe3-9c7f85d7c38e</serial>
Nov 02 12:11:24 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:11:24 user nova-compute[74534]: </disk>
Nov 02 12:11:24 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:11:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully detached device vdb from instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 from the persistent domain config.
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:11:24 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:24 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:11:24 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:11:24 user nova-compute[74534]:   <serial>064bf791-6451-45fe-bfe3-9c7f85d7c38e</serial>
Nov 02 12:11:24 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:11:24 user nova-compute[74534]: </disk>
Nov 02 12:11:24 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:11:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Instance destroyed successfully.
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'resources' on Instance uuid 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1768322974',display_name='tempest-AttachVolumeNegativeTest-server-1768322974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1768322974',id=7,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI61lxQw7l6KCLK+hHm1rsjvRdqi1yqyMfWAgMhmL3U0dK9GxMwirSRPEH0z8E8uN+8VAWKtaheOxo/PMD17m+UUwfyFLn1gLXDTeY1oGnTHV9Wt80xqBMxO/vsD1szmRA==',key_name='tempest-keypair-1969996733',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-pqiwp23d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "540e495f-ada0-44bf-99e7-767cb2a0e193", "address": "fa:16:3e:d7:77:65", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap540e495f-ad", "ovs_interfaceid": "540e495f-ada0-44bf-99e7-767cb2a0e193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:77:65,bridge_name='br-int',has_traffic_filtering=True,id=540e495f-ada0-44bf-99e7-767cb2a0e193,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e495f-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG os_vif [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:77:65,bridge_name='br-int',has_traffic_filtering=True,id=540e495f-ada0-44bf-99e7-767cb2a0e193,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e495f-ad') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap540e495f-ad, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=feaecce1-c367-4fed-94c9-62131a709f50) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:24 user nova-compute[74534]: INFO os_vif [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:77:65,bridge_name='br-int',has_traffic_filtering=True,id=540e495f-ada0-44bf-99e7-767cb2a0e193,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap540e495f-ad')
Nov 02 12:11:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Deleting instance files /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12_del
Nov 02 12:11:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Deletion of /opt/stack/data/nova/instances/2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12_del complete
Nov 02 12:11:24 user nova-compute[74534]: INFO nova.compute.manager [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-vif-unplugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] No waiting events found dispatching network-vif-unplugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-vif-unplugged-540e495f-ada0-44bf-99e7-767cb2a0e193 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] Acquiring lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] No waiting events found dispatching network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:24 user nova-compute[74534]: WARNING nova.compute.manager [req-07e2761a-3a42-4ff1-856d-55223826ebed req-dbb260e3-a472-4ac3-b09c-85b36245ae60 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received unexpected event network-vif-plugged-540e495f-ada0-44bf-99e7-767cb2a0e193 for instance with vm_state active and task_state deleting.
Nov 02 12:11:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:11:25 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:25 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Took 1.29 seconds to deallocate network for instance.
Nov 02 12:11:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:26 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:11:26 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:11:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:26 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Deleted allocations for instance 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12
Nov 02 12:11:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e540ad90-8c95-4c79-aedf-8484d1f0b12e tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.063s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-bc386073-7657-42e4-a5be-aa4e06868685 req-37f24a0e-35ea-4d6e-851a-9b8da17039d7 service nova] [instance: 2e8fa0c6-2676-4c7b-921e-fcfbeff5ef12] Received event network-vif-deleted-540e495f-ada0-44bf-99e7-767cb2a0e193 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:11:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Creating image(s)
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Ensure instance console log exists: /opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Start _get_guest_xml network_info=[{"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': '68acf395-0203-4627-bf00-6920490d58f3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9159e85-6d12-4166-be94-8f8b1620761a', 'attached_at': '', 'detached_at': '', 'volume_id': '23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'serial': '23064b31-3e27-4c42-85d0-0cc2fe4ba016'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:11:32 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:32 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:32 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:32 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:32 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8016af2a-ade2-48a9-b1b3-ff53da039409]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:11:32 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7c19e-6e0c-4b7a-9151-03462fad5aff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016] added
Nov 02 12:11:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee17c3e-44f6-4314-813a-2be1543e6b93]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb6ae0-2d7e-4bb7-be23-ad8c8cca1cf8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUWjdena {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUWjdena" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[42549f32-ce72-49ee-b3a3-0bd9d7658f17]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUWjdena'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a16133-04d0-4658-9a26-dd0b9ab4f2dc]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[122613b1-d6a5-4734-b974-3ece8f9f6661]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d052cdbe-dca5-4846-b1ad-4c7d867fe162]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]
Nov 02 12:11:32 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.
Nov 02 12:11:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3125fa-13be-43a9-b2d1-dc4ee15a5d60]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[18844393-bdc8-4d41-ac48-7868a1359726]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:32 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb215e-f107-4384-9456-4de60c06c6d0]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23531373934333563', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531373934333563', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1718226071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718226071',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUvT97WEExqR0OQmGwpmELMt+ImPLb1+mXmovwHR4XLPFB0ez6vAOasZmSPO2WheLOO9pmkHuFYo38fre1rCWoG3U01qW0dS1//or12B5d7TtxG9aJO7yiW6xIGkwXZog==',key_name='tempest-keypair-1558372433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d863bade99ab4f4e946637975a0f7224',ramdisk_id='',reservation_id='r-pec8wqms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1315298848',owner_user_name='tempest-ServerActionsV293TestJSON-1315298848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3db2c5117c754142978c7a872de22fb4',uuid=a9159e85-6d12-4166-be94-8f8b1620761a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converting VIF {"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.objects.instance [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lazy-loading 'pci_devices' on Instance uuid a9159e85-6d12-4166-be94-8f8b1620761a {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:11:33 user nova-compute[74534]:   <uuid>a9159e85-6d12-4166-be94-8f8b1620761a</uuid>
Nov 02 12:11:33 user nova-compute[74534]:   <name>instance-00000013</name>
Nov 02 12:11:33 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:11:33 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:11:33 user nova-compute[74534]:   <metadata>
Nov 02 12:11:33 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:11:33 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:11:33 user nova-compute[74534]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1718226071</nova:name>
Nov 02 12:11:33 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:11:32</nova:creationTime>
Nov 02 12:11:33 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:11:33 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:11:33 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:11:33 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:11:33 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:11:33 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:11:33 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:11:33 user nova-compute[74534]:       <nova:owner>
Nov 02 12:11:33 user nova-compute[74534]:         <nova:user uuid="3db2c5117c754142978c7a872de22fb4">tempest-ServerActionsV293TestJSON-1315298848-project-member</nova:user>
Nov 02 12:11:33 user nova-compute[74534]:         <nova:project uuid="d863bade99ab4f4e946637975a0f7224">tempest-ServerActionsV293TestJSON-1315298848</nova:project>
Nov 02 12:11:33 user nova-compute[74534]:       </nova:owner>
Nov 02 12:11:33 user nova-compute[74534]:       <nova:ports>
Nov 02 12:11:33 user nova-compute[74534]:         <nova:port uuid="3704c8b5-ecf1-441a-8c0e-9219f2e12835">
Nov 02 12:11:33 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 12:11:33 user nova-compute[74534]:         </nova:port>
Nov 02 12:11:33 user nova-compute[74534]:       </nova:ports>
Nov 02 12:11:33 user nova-compute[74534]:     </nova:instance>
Nov 02 12:11:33 user nova-compute[74534]:   </metadata>
Nov 02 12:11:33 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:11:33 user nova-compute[74534]:     <system>
Nov 02 12:11:33 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:11:33 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:11:33 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:11:33 user nova-compute[74534]:       <entry name="serial">a9159e85-6d12-4166-be94-8f8b1620761a</entry>
Nov 02 12:11:33 user nova-compute[74534]:       <entry name="uuid">a9159e85-6d12-4166-be94-8f8b1620761a</entry>
Nov 02 12:11:33 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:11:33 user nova-compute[74534]:     </system>
Nov 02 12:11:33 user nova-compute[74534]:   </sysinfo>
Nov 02 12:11:33 user nova-compute[74534]:   <os>
Nov 02 12:11:33 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:11:33 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:11:33 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:11:33 user nova-compute[74534]:   </os>
Nov 02 12:11:33 user nova-compute[74534]:   <features>
Nov 02 12:11:33 user nova-compute[74534]:     <acpi/>
Nov 02 12:11:33 user nova-compute[74534]:     <apic/>
Nov 02 12:11:33 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:11:33 user nova-compute[74534]:   </features>
Nov 02 12:11:33 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:11:33 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:11:33 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:11:33 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:11:33 user nova-compute[74534]:   </clock>
Nov 02 12:11:33 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:11:33 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:11:33 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:11:33 user nova-compute[74534]:   </cpu>
Nov 02 12:11:33 user nova-compute[74534]:   <devices>
Nov 02 12:11:33 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:11:33 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:33 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:11:33 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:11:33 user nova-compute[74534]:       <serial>23064b31-3e27-4c42-85d0-0cc2fe4ba016</serial>
Nov 02 12:11:33 user nova-compute[74534]:     </disk>
Nov 02 12:11:33 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:11:33 user nova-compute[74534]:       <mac address="fa:16:3e:31:93:02"/>
Nov 02 12:11:33 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:33 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:11:33 user nova-compute[74534]:       <target dev="tap3704c8b5-ec"/>
Nov 02 12:11:33 user nova-compute[74534]:     </interface>
Nov 02 12:11:33 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:11:33 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a/console.log" append="off"/>
Nov 02 12:11:33 user nova-compute[74534]:     </serial>
Nov 02 12:11:33 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:11:33 user nova-compute[74534]:     <video>
Nov 02 12:11:33 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:33 user nova-compute[74534]:     </video>
Nov 02 12:11:33 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:11:33 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:11:33 user nova-compute[74534]:     </rng>
Nov 02 12:11:33 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:11:33 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:11:33 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:11:33 user nova-compute[74534]:     </memballoon>
Nov 02 12:11:33 user nova-compute[74534]:   </devices>
Nov 02 12:11:33 user nova-compute[74534]: </domain>
Nov 02 12:11:33 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1718226071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718226071',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUvT97WEExqR0OQmGwpmELMt+ImPLb1+mXmovwHR4XLPFB0ez6vAOasZmSPO2WheLOO9pmkHuFYo38fre1rCWoG3U01qW0dS1//or12B5d7TtxG9aJO7yiW6xIGkwXZog==',key_name='tempest-keypair-1558372433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d863bade99ab4f4e946637975a0f7224',ramdisk_id='',reservation_id='r-pec8wqms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1315298848',owner_user_name='tempest-ServerActionsV293TestJSON-1315298848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3db2c5117c754142978c7a872de22fb4',uuid=a9159e85-6d12-4166-be94-8f8b1620761a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converting VIF {"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG os_vif [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8dbca30-c6ec-5014-8e2b-3d2613acb6d9', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3704c8b5-ec, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3704c8b5-ec, col_values=(('qos', UUID('10007a99-27d5-4d85-b921-f8625f31897f')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3704c8b5-ec, col_values=(('external_ids', {'iface-id': '3704c8b5-ecf1-441a-8c0e-9219f2e12835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:93:02', 'vm-uuid': 'a9159e85-6d12-4166-be94-8f8b1620761a'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:33 user nova-compute[74534]: INFO os_vif [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec')
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:11:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] No VIF found with MAC fa:16:3e:31:93:02, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-815a32cf-9849-454c-b237-4da5292ae75a req-c1f44b78-96fb-4508-beb7-5e8fd053a2dd service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-815a32cf-9849-454c-b237-4da5292ae75a req-c1f44b78-96fb-4508-beb7-5e8fd053a2dd service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-815a32cf-9849-454c-b237-4da5292ae75a req-c1f44b78-96fb-4508-beb7-5e8fd053a2dd service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-815a32cf-9849-454c-b237-4da5292ae75a req-c1f44b78-96fb-4508-beb7-5e8fd053a2dd service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-815a32cf-9849-454c-b237-4da5292ae75a req-c1f44b78-96fb-4508-beb7-5e8fd053a2dd service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:35 user nova-compute[74534]: WARNING nova.compute.manager [req-815a32cf-9849-454c-b237-4da5292ae75a req-c1f44b78-96fb-4508-beb7-5e8fd053a2dd service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received unexpected event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with vm_state building and task_state spawning.
Nov 02 12:11:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-a411b023-06ea-41e4-a56a-04ed28e02e6b req-5f55650b-934c-455d-9abf-9d2619ac3969 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a411b023-06ea-41e4-a56a-04ed28e02e6b req-5f55650b-934c-455d-9abf-9d2619ac3969 service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a411b023-06ea-41e4-a56a-04ed28e02e6b req-5f55650b-934c-455d-9abf-9d2619ac3969 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a411b023-06ea-41e4-a56a-04ed28e02e6b req-5f55650b-934c-455d-9abf-9d2619ac3969 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-a411b023-06ea-41e4-a56a-04ed28e02e6b req-5f55650b-934c-455d-9abf-9d2619ac3969 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:37 user nova-compute[74534]: WARNING nova.compute.manager [req-a411b023-06ea-41e4-a56a-04ed28e02e6b req-5f55650b-934c-455d-9abf-9d2619ac3969 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received unexpected event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with vm_state building and task_state spawning.
Nov 02 12:11:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance spawned successfully.
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:37 user nova-compute[74534]: INFO nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 02 12:11:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:37 user nova-compute[74534]: INFO nova.compute.manager [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Took 30.33 seconds to build instance.
Nov 02 12:11:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f2d97a52-e419-4378-b5dd-29aefc3e68e2 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.447s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "a9159e85-6d12-4166-be94-8f8b1620761a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.392s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:37 user nova-compute[74534]: INFO nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 02 12:11:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "a9159e85-6d12-4166-be94-8f8b1620761a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:11:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Creating image(s)
Nov 02 12:11:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.213s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk 1073741824" returned: 0 in 0.059s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.230s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Cannot resize image /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Ensure instance console log exists: /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Start _get_guest_xml network_info=[{"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'guest_format': None, 'attachment_id': '8173d66a-71d6-4c18-92a6-943dc42f5484', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '530fbde9-c0cf-4f20-9b7c-b91296394e2e', 'attached_at': '', 'detached_at': '', 'volume_id': '63b6a609-c704-4b97-99c0-03babdd70321', 'serial': '63b6a609-c704-4b97-99c0-03babdd70321'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:11:39 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 12:11:39 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'vcpu_model' on Instance uuid 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:39 user nova-compute[74534]: INFO nova.compute.manager [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Unrescuing
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:39 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59678cc7-0dbb-44c3-9d3e-30c46f7fca51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:11:39 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc1451-faae-4779-9800-56bf2f7f4d74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321] added
Nov 02 12:11:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[95212706-a285-46ad-90e3-c2aee1c05341]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca79563-d00f-425f-8b6c-324d471086cb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FibhWnwe {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FibhWnwe" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46fc47-a160-4413-a306-d993ca91dba1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FibhWnwe'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef71c56-184e-42d9-b3d6-2b821691c939]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d062a0-95cb-44a2-a84f-2af1cca91ce5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b679bfb9-a801-4511-b42e-164aa6e65edf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]
Nov 02 12:11:40 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.
Nov 02 12:11:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8074fcf-2866-48aa-95d6-23e3f86f7e8d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba56a6-ce7d-4360-af39-8de51f8ab8cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6ebced-3a89-4caf-a54e-011ee7ba0888]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG nova.network.neutron [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating instance_info_cache with network_info: [{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'flavor' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-ba4eb7a8-f3df-4e9f-96b7-8d38779d8fa7 req-5a7e7519-0edf-4ced-ab87-5e0e430f8228 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ba4eb7a8-f3df-4e9f-96b7-8d38779d8fa7 req-5a7e7519-0edf-4ced-ab87-5e0e430f8228 service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ba4eb7a8-f3df-4e9f-96b7-8d38779d8fa7 req-5a7e7519-0edf-4ced-ab87-5e0e430f8228 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ba4eb7a8-f3df-4e9f-96b7-8d38779d8fa7 req-5a7e7519-0edf-4ced-ab87-5e0e430f8228 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-ba4eb7a8-f3df-4e9f-96b7-8d38779d8fa7 req-5a7e7519-0edf-4ced-ab87-5e0e430f8228 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:40 user nova-compute[74534]: WARNING nova.compute.manager [req-ba4eb7a8-f3df-4e9f-96b7-8d38779d8fa7 req-5a7e7519-0edf-4ced-ab87-5e0e430f8228 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23865306239313238', 'path': '/dev/sde'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865306239313238', 'path': '/dev/sde'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-494432744',display_name='tempest-ServerActionsTestOtherA-server-998874074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-494432744',id=15,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0Er+iV0JuqGua4bxljSzid6e+SBjxx22nRQ+h73MhbqL5/talrrpwV6bPTgkxz82FgRzDTXzhYgQCd6uha9SECrsSRu7T8feWG69VkQgQbXnJ9BhWbbsv4PIJhs9P1cg==',key_name='tempest-keypair-2079383095',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-g4t4y7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=530fbde9-c0cf-4f20-9b7c-b91296394e2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:11:41 user nova-compute[74534]:   <uuid>530fbde9-c0cf-4f20-9b7c-b91296394e2e</uuid>
Nov 02 12:11:41 user nova-compute[74534]:   <name>instance-0000000f</name>
Nov 02 12:11:41 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:11:41 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:11:41 user nova-compute[74534]:   <metadata>
Nov 02 12:11:41 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:11:41 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:11:41 user nova-compute[74534]:       <nova:name>tempest-ServerActionsTestOtherA-server-998874074</nova:name>
Nov 02 12:11:41 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:11:39</nova:creationTime>
Nov 02 12:11:41 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:11:41 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:11:41 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:11:41 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:11:41 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:11:41 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:11:41 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:11:41 user nova-compute[74534]:       <nova:owner>
Nov 02 12:11:41 user nova-compute[74534]:         <nova:user uuid="ec72fd62d437457ba42756f1da97516c">tempest-ServerActionsTestOtherA-500741581-project-member</nova:user>
Nov 02 12:11:41 user nova-compute[74534]:         <nova:project uuid="f787c9b1e8154b4da75ac5299c888706">tempest-ServerActionsTestOtherA-500741581</nova:project>
Nov 02 12:11:41 user nova-compute[74534]:       </nova:owner>
Nov 02 12:11:41 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:11:41 user nova-compute[74534]:       <nova:ports>
Nov 02 12:11:41 user nova-compute[74534]:         <nova:port uuid="df1e966f-35ba-4e1e-b92b-e35ba3d79b61">
Nov 02 12:11:41 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 12:11:41 user nova-compute[74534]:         </nova:port>
Nov 02 12:11:41 user nova-compute[74534]:       </nova:ports>
Nov 02 12:11:41 user nova-compute[74534]:     </nova:instance>
Nov 02 12:11:41 user nova-compute[74534]:   </metadata>
Nov 02 12:11:41 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:11:41 user nova-compute[74534]:     <system>
Nov 02 12:11:41 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:11:41 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:11:41 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:11:41 user nova-compute[74534]:       <entry name="serial">530fbde9-c0cf-4f20-9b7c-b91296394e2e</entry>
Nov 02 12:11:41 user nova-compute[74534]:       <entry name="uuid">530fbde9-c0cf-4f20-9b7c-b91296394e2e</entry>
Nov 02 12:11:41 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:11:41 user nova-compute[74534]:     </system>
Nov 02 12:11:41 user nova-compute[74534]:   </sysinfo>
Nov 02 12:11:41 user nova-compute[74534]:   <os>
Nov 02 12:11:41 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:11:41 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:11:41 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:11:41 user nova-compute[74534]:   </os>
Nov 02 12:11:41 user nova-compute[74534]:   <features>
Nov 02 12:11:41 user nova-compute[74534]:     <acpi/>
Nov 02 12:11:41 user nova-compute[74534]:     <apic/>
Nov 02 12:11:41 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:11:41 user nova-compute[74534]:   </features>
Nov 02 12:11:41 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:11:41 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:11:41 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:11:41 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:11:41 user nova-compute[74534]:   </clock>
Nov 02 12:11:41 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:11:41 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:11:41 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:11:41 user nova-compute[74534]:   </cpu>
Nov 02 12:11:41 user nova-compute[74534]:   <devices>
Nov 02 12:11:41 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:11:41 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:11:41 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk"/>
Nov 02 12:11:41 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:11:41 user nova-compute[74534]:     </disk>
Nov 02 12:11:41 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:11:41 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:41 user nova-compute[74534]:       <source dev="/dev/sde"/>
Nov 02 12:11:41 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:11:41 user nova-compute[74534]:       <serial>63b6a609-c704-4b97-99c0-03babdd70321</serial>
Nov 02 12:11:41 user nova-compute[74534]:     </disk>
Nov 02 12:11:41 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:11:41 user nova-compute[74534]:       <mac address="fa:16:3e:b9:fb:c9"/>
Nov 02 12:11:41 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:41 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:11:41 user nova-compute[74534]:       <target dev="tapdf1e966f-35"/>
Nov 02 12:11:41 user nova-compute[74534]:     </interface>
Nov 02 12:11:41 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:11:41 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/console.log" append="off"/>
Nov 02 12:11:41 user nova-compute[74534]:     </serial>
Nov 02 12:11:41 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:11:41 user nova-compute[74534]:     <video>
Nov 02 12:11:41 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:41 user nova-compute[74534]:     </video>
Nov 02 12:11:41 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:11:41 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:11:41 user nova-compute[74534]:     </rng>
Nov 02 12:11:41 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:11:41 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:11:41 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:11:41 user nova-compute[74534]:     </memballoon>
Nov 02 12:11:41 user nova-compute[74534]:   </devices>
Nov 02 12:11:41 user nova-compute[74534]: </domain>
Nov 02 12:11:41 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-494432744',display_name='tempest-ServerActionsTestOtherA-server-998874074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-494432744',id=15,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0Er+iV0JuqGua4bxljSzid6e+SBjxx22nRQ+h73MhbqL5/talrrpwV6bPTgkxz82FgRzDTXzhYgQCd6uha9SECrsSRu7T8feWG69VkQgQbXnJ9BhWbbsv4PIJhs9P1cg==',key_name='tempest-keypair-2079383095',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-g4t4y7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=530fbde9-c0cf-4f20-9b7c-b91296394e2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG os_vif [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10f3da87-371d-560b-81f7-071e2e1c954b', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf1e966f-35, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf1e966f-35, col_values=(('qos', UUID('8c257d70-3fd0-45f0-97ef-bc4e92b73521')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf1e966f-35, col_values=(('external_ids', {'iface-id': 'df1e966f-35ba-4e1e-b92b-e35ba3d79b61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:fb:c9', 'vm-uuid': '530fbde9-c0cf-4f20-9b7c-b91296394e2e'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:41 user nova-compute[74534]: INFO os_vif [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35')
Nov 02 12:11:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance destroyed successfully.
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No VIF found with MAC fa:16:3e:b9:fb:c9, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:11:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-e91f866d-c73f-46de-a53b-8b6d5f1b108d req-18a57612-b366-4f8d-bce0-6287d3c5cebb service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e91f866d-c73f-46de-a53b-8b6d5f1b108d req-18a57612-b366-4f8d-bce0-6287d3c5cebb service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e91f866d-c73f-46de-a53b-8b6d5f1b108d req-18a57612-b366-4f8d-bce0-6287d3c5cebb service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e91f866d-c73f-46de-a53b-8b6d5f1b108d req-18a57612-b366-4f8d-bce0-6287d3c5cebb service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-e91f866d-c73f-46de-a53b-8b6d5f1b108d req-18a57612-b366-4f8d-bce0-6287d3c5cebb service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:42 user nova-compute[74534]: WARNING nova.compute.manager [req-e91f866d-c73f-46de-a53b-8b6d5f1b108d req-18a57612-b366-4f8d-bce0-6287d3c5cebb service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:43 user nova-compute[74534]: INFO nova.compute.manager [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Detaching volume 58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:11:43 user nova-compute[74534]: INFO nova.virt.block_device [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Attempting to driver detach volume 58ba8952-292f-4352-9cdf-ecaec6db2af2 from mountpoint /dev/vdb
Nov 02 12:11:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Attempting to detach device vdb from instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:11:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:11:43 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:43 user nova-compute[74534]:   <source dev="/dev/sdh"/>
Nov 02 12:11:43 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:11:43 user nova-compute[74534]:   <serial>58ba8952-292f-4352-9cdf-ecaec6db2af2</serial>
Nov 02 12:11:43 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:11:43 user nova-compute[74534]: </disk>
Nov 02 12:11:43 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:11:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Successfully detached device vdb from instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 from the persistent domain config.
Nov 02 12:11:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:11:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:11:43 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:11:43 user nova-compute[74534]:   <source dev="/dev/sdh"/>
Nov 02 12:11:43 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:11:43 user nova-compute[74534]:   <serial>58ba8952-292f-4352-9cdf-ecaec6db2af2</serial>
Nov 02 12:11:43 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:11:43 user nova-compute[74534]: </disk>
Nov 02 12:11:43 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:11:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:11:44 user nova-compute[74534]: INFO nova.compute.claims [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Claim successful on node user
Nov 02 12:11:44 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 is timed out.
Nov 02 12:11:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully detached device vdb from instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 from the live domain config.
Nov 02 12:11:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfhdpPuj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:11:44 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:11:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:11:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbfc940-80b4-431a-ab0d-ffb12a7636c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:11:45 user nova-compute[74534]: No targets found.
Nov 02 12:11:45 user nova-compute[74534]: iSNS:
Nov 02 12:11:45 user nova-compute[74534]: No targets found.
Nov 02 12:11:45 user nova-compute[74534]: STATIC:
Nov 02 12:11:45 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e
Nov 02 12:11:45 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:45 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:45 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:11:45 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:45 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:45 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016
Nov 02 12:11:45 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:45 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:45 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:11:45 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:45 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:45 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:11:45 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:11:45 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:11:45 user nova-compute[74534]: FIRMWARE:
Nov 02 12:11:45 user nova-compute[74534]: No targets found.
Nov 02 12:11:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:11:45 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:11:45 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:45 user nova-compute[74534]: WARNING nova.compute.manager [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:45 user nova-compute[74534]: WARNING nova.compute.manager [req-50d82913-73c5-40c0-9ebd-7cfd06dfe5f2 req-d011d5b2-c931-44d6-8296-42b0d884c428 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a283c4ff-ba6d-4b70-a93b-5414fa4c06a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[77385e12-a608-4680-bc2e-b414cce2560f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:11:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c64cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[39557dc5-4f0e-4b51-bbc1-baf5c169d4fd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c39603-5dab-45c3-bdb5-8e2edf2d162c]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c38f1c-2886-48a9-909f-b2ef72838b73]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c53d3-77de-48ab-b2d3-92bf8ef0ddae]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f22b48-959f-4312-9e58-36a58bacd634]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-c52ed59c-111b-4807-b47a-002254825faf req-d0caf12b-de75-42ae-87ab-b0fac8424db5 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c52ed59c-111b-4807-b47a-002254825faf req-d0caf12b-de75-42ae-87ab-b0fac8424db5 service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c52ed59c-111b-4807-b47a-002254825faf req-d0caf12b-de75-42ae-87ab-b0fac8424db5 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c52ed59c-111b-4807-b47a-002254825faf req-d0caf12b-de75-42ae-87ab-b0fac8424db5 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-c52ed59c-111b-4807-b47a-002254825faf req-d0caf12b-de75-42ae-87ab-b0fac8424db5 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:45 user nova-compute[74534]: WARNING nova.compute.manager [req-c52ed59c-111b-4807-b47a-002254825faf req-d0caf12b-de75-42ae-87ab-b0fac8424db5 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received unexpected event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5e26e-fc6d-4517-a0c9-7ef66f77eac9]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260]
Nov 02 12:11:45 user nova-compute[74534]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e, portal: 172.16.0.220,3260] successful.
Nov 02 12:11:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064bf791-6451-45fe-bfe3-9c7f85d7c38e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b21b4-0e78-44ef-a5a0-ceaad11dd857]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== disconnect_volume: return (444ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.011s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:11:45 user nova-compute[74534]: INFO nova.compute.claims [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Claim successful on node user
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:11:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:11:45 user nova-compute[74534]: DEBUG nova.policy [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0dabe5e283645a382a1f0bf6ab7ddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294df1c916c248d496812d8b2bb1b57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:11:46 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Creating image(s)
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk 1073741824" returned: 0 in 0.067s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Successfully created port: 0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.objects.instance [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:46 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cd8d391d-d3ab-452e-8516-71aaa5f927cd tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.488s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.policy [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0dabe5e283645a382a1f0bf6ab7ddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294df1c916c248d496812d8b2bb1b57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.217s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:11:46 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Creating image(s)
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Cannot resize image /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Ensure instance console log exists: /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:46 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ad878633-c5b2-496e-9bdb-7657c4db5eba tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ad878633-c5b2-496e-9bdb-7657c4db5eba tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ad878633-c5b2-496e-9bdb-7657c4db5eba tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ad878633-c5b2-496e-9bdb-7657c4db5eba tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74534) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ad878633-c5b2-496e-9bdb-7657c4db5eba tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.220s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk 1073741824" returned: 0 in 0.096s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-c068c295-7826-48d1-8352-39efbd868c0c req-be874de0-0c65-4d49-8d73-132da6343ce5 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c068c295-7826-48d1-8352-39efbd868c0c req-be874de0-0c65-4d49-8d73-132da6343ce5 service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c068c295-7826-48d1-8352-39efbd868c0c req-be874de0-0c65-4d49-8d73-132da6343ce5 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c068c295-7826-48d1-8352-39efbd868c0c req-be874de0-0c65-4d49-8d73-132da6343ce5 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-c068c295-7826-48d1-8352-39efbd868c0c req-be874de0-0c65-4d49-8d73-132da6343ce5 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:47 user nova-compute[74534]: WARNING nova.compute.manager [req-c068c295-7826-48d1-8352-39efbd868c0c req-be874de0-0c65-4d49-8d73-132da6343ce5 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received unexpected event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-72623fce-3cbd-4210-8795-28071841d9c0 req-bee22679-bd2e-4a00-bd03-c5cc689918ff service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-72623fce-3cbd-4210-8795-28071841d9c0 req-bee22679-bd2e-4a00-bd03-c5cc689918ff service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-72623fce-3cbd-4210-8795-28071841d9c0 req-bee22679-bd2e-4a00-bd03-c5cc689918ff service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-72623fce-3cbd-4210-8795-28071841d9c0 req-bee22679-bd2e-4a00-bd03-c5cc689918ff service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-72623fce-3cbd-4210-8795-28071841d9c0 req-bee22679-bd2e-4a00-bd03-c5cc689918ff service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:47 user nova-compute[74534]: WARNING nova.compute.manager [req-72623fce-3cbd-4210-8795-28071841d9c0 req-bee22679-bd2e-4a00-bd03-c5cc689918ff service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state active and task_state powering-off.
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1199e3d6-d211-4919-98e1-5652175c220f tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.248s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Successfully created port: d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Successfully updated port: 0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-changed-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Refreshing instance network info cache due to event network-changed-0ac87943-5280-44ef-9afa-523d2b996e19. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] Acquiring lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance spawned successfully.
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Cannot resize image /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Ensure instance console log exists: /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance destroyed successfully.
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ad878633-c5b2-496e-9bdb-7657c4db5eba tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ad878633-c5b2-496e-9bdb-7657c4db5eba tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.896s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:47 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74534) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bbf3c791-bb04-4726-afef-c00fe1794170 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance network_info: |[{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] Acquired lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Refreshing network info cache for port 0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Start _get_guest_xml network_info=[{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:11:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-771521797',display_name='tempest-ServerRescueNegativeTestJSON-server-771521797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-771521797',id=20,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-i1b2l74y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:46Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=90d26a35-e2a4-4f31-bc84-579e2ab28798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'pci_devices' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:11:48 user nova-compute[74534]:   <uuid>90d26a35-e2a4-4f31-bc84-579e2ab28798</uuid>
Nov 02 12:11:48 user nova-compute[74534]:   <name>instance-00000014</name>
Nov 02 12:11:48 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:11:48 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:11:48 user nova-compute[74534]:   <metadata>
Nov 02 12:11:48 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:11:48 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:11:48 user nova-compute[74534]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-771521797</nova:name>
Nov 02 12:11:48 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:11:48</nova:creationTime>
Nov 02 12:11:48 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:11:48 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:11:48 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:11:48 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:11:48 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:11:48 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:11:48 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:11:48 user nova-compute[74534]:       <nova:owner>
Nov 02 12:11:48 user nova-compute[74534]:         <nova:user uuid="c0dabe5e283645a382a1f0bf6ab7ddf1">tempest-ServerRescueNegativeTestJSON-158551613-project-member</nova:user>
Nov 02 12:11:48 user nova-compute[74534]:         <nova:project uuid="294df1c916c248d496812d8b2bb1b57e">tempest-ServerRescueNegativeTestJSON-158551613</nova:project>
Nov 02 12:11:48 user nova-compute[74534]:       </nova:owner>
Nov 02 12:11:48 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:11:48 user nova-compute[74534]:       <nova:ports>
Nov 02 12:11:48 user nova-compute[74534]:         <nova:port uuid="0ac87943-5280-44ef-9afa-523d2b996e19">
Nov 02 12:11:48 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 12:11:48 user nova-compute[74534]:         </nova:port>
Nov 02 12:11:48 user nova-compute[74534]:       </nova:ports>
Nov 02 12:11:48 user nova-compute[74534]:     </nova:instance>
Nov 02 12:11:48 user nova-compute[74534]:   </metadata>
Nov 02 12:11:48 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:11:48 user nova-compute[74534]:     <system>
Nov 02 12:11:48 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:11:48 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:11:48 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:11:48 user nova-compute[74534]:       <entry name="serial">90d26a35-e2a4-4f31-bc84-579e2ab28798</entry>
Nov 02 12:11:48 user nova-compute[74534]:       <entry name="uuid">90d26a35-e2a4-4f31-bc84-579e2ab28798</entry>
Nov 02 12:11:48 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:11:48 user nova-compute[74534]:     </system>
Nov 02 12:11:48 user nova-compute[74534]:   </sysinfo>
Nov 02 12:11:48 user nova-compute[74534]:   <os>
Nov 02 12:11:48 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:11:48 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:11:48 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:11:48 user nova-compute[74534]:   </os>
Nov 02 12:11:48 user nova-compute[74534]:   <features>
Nov 02 12:11:48 user nova-compute[74534]:     <acpi/>
Nov 02 12:11:48 user nova-compute[74534]:     <apic/>
Nov 02 12:11:48 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:11:48 user nova-compute[74534]:   </features>
Nov 02 12:11:48 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:11:48 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:11:48 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:11:48 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:11:48 user nova-compute[74534]:   </clock>
Nov 02 12:11:48 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:11:48 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:11:48 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:11:48 user nova-compute[74534]:   </cpu>
Nov 02 12:11:48 user nova-compute[74534]:   <devices>
Nov 02 12:11:48 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:11:48 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:11:48 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk"/>
Nov 02 12:11:48 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:11:48 user nova-compute[74534]:     </disk>
Nov 02 12:11:48 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:11:48 user nova-compute[74534]:       <mac address="fa:16:3e:0c:a6:a3"/>
Nov 02 12:11:48 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:48 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:11:48 user nova-compute[74534]:       <target dev="tap0ac87943-52"/>
Nov 02 12:11:48 user nova-compute[74534]:     </interface>
Nov 02 12:11:48 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:11:48 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/console.log" append="off"/>
Nov 02 12:11:48 user nova-compute[74534]:     </serial>
Nov 02 12:11:48 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:11:48 user nova-compute[74534]:     <video>
Nov 02 12:11:48 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:48 user nova-compute[74534]:     </video>
Nov 02 12:11:48 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:11:48 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:11:48 user nova-compute[74534]:     </rng>
Nov 02 12:11:48 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:11:48 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:11:48 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:11:48 user nova-compute[74534]:     </memballoon>
Nov 02 12:11:48 user nova-compute[74534]:   </devices>
Nov 02 12:11:48 user nova-compute[74534]: </domain>
Nov 02 12:11:48 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-771521797',display_name='tempest-ServerRescueNegativeTestJSON-server-771521797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-771521797',id=20,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-i1b2l74y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:46Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=90d26a35-e2a4-4f31-bc84-579e2ab28798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG os_vif [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a429cc2-d71e-5b44-8d1c-1231a52e03de', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ac87943-52, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ac87943-52, col_values=(('qos', UUID('119e43b5-e447-482c-a532-1e7e1fbe9f10')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ac87943-52, col_values=(('external_ids', {'iface-id': '0ac87943-5280-44ef-9afa-523d2b996e19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:a6:a3', 'vm-uuid': '90d26a35-e2a4-4f31-bc84-579e2ab28798'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:48 user nova-compute[74534]: INFO os_vif [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52')
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Successfully updated port: d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No VIF found with MAC fa:16:3e:0c:a6:a3, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:11:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.neutron [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updated VIF entry in instance network info cache for port 0ac87943-5280-44ef-9afa-523d2b996e19. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.neutron [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4b01238b-57dc-44e8-95eb-6d66ce621cbe req-0b632493-ad5e-4a4f-8d98-b2cc3d47ae17 service nova] Releasing lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance network_info: |[{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Start _get_guest_xml network_info=[{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:11:49 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:49 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1669898121',display_name='tempest-ServerRescueNegativeTestJSON-server-1669898121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1669898121',id=21,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-kbh3bbls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:47Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=57ce1c49-200f-4b56-a1b7-78aeec6fc3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'pci_devices' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:11:49 user nova-compute[74534]:   <uuid>57ce1c49-200f-4b56-a1b7-78aeec6fc3ac</uuid>
Nov 02 12:11:49 user nova-compute[74534]:   <name>instance-00000015</name>
Nov 02 12:11:49 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:11:49 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:11:49 user nova-compute[74534]:   <metadata>
Nov 02 12:11:49 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:11:49 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:11:49 user nova-compute[74534]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1669898121</nova:name>
Nov 02 12:11:49 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:11:49</nova:creationTime>
Nov 02 12:11:49 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:11:49 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:11:49 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:11:49 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:11:49 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:11:49 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:11:49 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:11:49 user nova-compute[74534]:       <nova:owner>
Nov 02 12:11:49 user nova-compute[74534]:         <nova:user uuid="c0dabe5e283645a382a1f0bf6ab7ddf1">tempest-ServerRescueNegativeTestJSON-158551613-project-member</nova:user>
Nov 02 12:11:49 user nova-compute[74534]:         <nova:project uuid="294df1c916c248d496812d8b2bb1b57e">tempest-ServerRescueNegativeTestJSON-158551613</nova:project>
Nov 02 12:11:49 user nova-compute[74534]:       </nova:owner>
Nov 02 12:11:49 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:11:49 user nova-compute[74534]:       <nova:ports>
Nov 02 12:11:49 user nova-compute[74534]:         <nova:port uuid="d9bef23e-680a-470e-b4dd-8162d69fa4df">
Nov 02 12:11:49 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 12:11:49 user nova-compute[74534]:         </nova:port>
Nov 02 12:11:49 user nova-compute[74534]:       </nova:ports>
Nov 02 12:11:49 user nova-compute[74534]:     </nova:instance>
Nov 02 12:11:49 user nova-compute[74534]:   </metadata>
Nov 02 12:11:49 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:11:49 user nova-compute[74534]:     <system>
Nov 02 12:11:49 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:11:49 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:11:49 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:11:49 user nova-compute[74534]:       <entry name="serial">57ce1c49-200f-4b56-a1b7-78aeec6fc3ac</entry>
Nov 02 12:11:49 user nova-compute[74534]:       <entry name="uuid">57ce1c49-200f-4b56-a1b7-78aeec6fc3ac</entry>
Nov 02 12:11:49 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:11:49 user nova-compute[74534]:     </system>
Nov 02 12:11:49 user nova-compute[74534]:   </sysinfo>
Nov 02 12:11:49 user nova-compute[74534]:   <os>
Nov 02 12:11:49 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:11:49 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:11:49 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:11:49 user nova-compute[74534]:   </os>
Nov 02 12:11:49 user nova-compute[74534]:   <features>
Nov 02 12:11:49 user nova-compute[74534]:     <acpi/>
Nov 02 12:11:49 user nova-compute[74534]:     <apic/>
Nov 02 12:11:49 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:11:49 user nova-compute[74534]:   </features>
Nov 02 12:11:49 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:11:49 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:11:49 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:11:49 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:11:49 user nova-compute[74534]:   </clock>
Nov 02 12:11:49 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:11:49 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:11:49 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:11:49 user nova-compute[74534]:   </cpu>
Nov 02 12:11:49 user nova-compute[74534]:   <devices>
Nov 02 12:11:49 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:11:49 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:11:49 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk"/>
Nov 02 12:11:49 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:11:49 user nova-compute[74534]:     </disk>
Nov 02 12:11:49 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:11:49 user nova-compute[74534]:       <mac address="fa:16:3e:75:4f:99"/>
Nov 02 12:11:49 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:49 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:11:49 user nova-compute[74534]:       <target dev="tapd9bef23e-68"/>
Nov 02 12:11:49 user nova-compute[74534]:     </interface>
Nov 02 12:11:49 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:11:49 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/console.log" append="off"/>
Nov 02 12:11:49 user nova-compute[74534]:     </serial>
Nov 02 12:11:49 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:11:49 user nova-compute[74534]:     <video>
Nov 02 12:11:49 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:11:49 user nova-compute[74534]:     </video>
Nov 02 12:11:49 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:11:49 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:11:49 user nova-compute[74534]:     </rng>
Nov 02 12:11:49 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:11:49 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:11:49 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:11:49 user nova-compute[74534]:     </memballoon>
Nov 02 12:11:49 user nova-compute[74534]:   </devices>
Nov 02 12:11:49 user nova-compute[74534]: </domain>
Nov 02 12:11:49 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1669898121',display_name='tempest-ServerRescueNegativeTestJSON-server-1669898121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1669898121',id=21,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-kbh3bbls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:47Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=57ce1c49-200f-4b56-a1b7-78aeec6fc3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG os_vif [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53165925-f6a0-5be5-abc9-0d9bf1e1b60c', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9bef23e-68, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9bef23e-68, col_values=(('qos', UUID('9ef22620-1783-4e1f-8859-a4169174c210')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9bef23e-68, col_values=(('external_ids', {'iface-id': 'd9bef23e-680a-470e-b4dd-8162d69fa4df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:4f:99', 'vm-uuid': '57ce1c49-200f-4b56-a1b7-78aeec6fc3ac'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:49 user nova-compute[74534]: INFO os_vif [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68')
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No VIF found with MAC fa:16:3e:75:4f:99, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-3a30e345-d133-45f7-bf47-a5cf710fb951 req-3ea13f99-816e-492e-add0-e9c09ffc178a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3a30e345-d133-45f7-bf47-a5cf710fb951 req-3ea13f99-816e-492e-add0-e9c09ffc178a service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3a30e345-d133-45f7-bf47-a5cf710fb951 req-3ea13f99-816e-492e-add0-e9c09ffc178a service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3a30e345-d133-45f7-bf47-a5cf710fb951 req-3ea13f99-816e-492e-add0-e9c09ffc178a service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-3a30e345-d133-45f7-bf47-a5cf710fb951 req-3ea13f99-816e-492e-add0-e9c09ffc178a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:49 user nova-compute[74534]: WARNING nova.compute.manager [req-3a30e345-d133-45f7-bf47-a5cf710fb951 req-3ea13f99-816e-492e-add0-e9c09ffc178a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state stopped and task_state None.
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-changed-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Refreshing instance network info cache due to event network-changed-d9bef23e-680a-470e-b4dd-8162d69fa4df. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] Acquiring lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] Acquired lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:11:49 user nova-compute[74534]: DEBUG nova.network.neutron [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Refreshing network info cache for port d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:11:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updated VIF entry in instance network info cache for port d9bef23e-680a-470e-b4dd-8162d69fa4df. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:11:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:11:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d5b041bb-a44c-44d1-97fb-7b56388a3584 req-858d1f34-693c-414f-899d-90df936968f0 service nova] Releasing lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:51 user nova-compute[74534]: WARNING nova.compute.manager [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state building and task_state spawning.
Nov 02 12:11:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:51 user nova-compute[74534]: WARNING nova.compute.manager [req-5c8b54ef-cd50-4910-9921-9102a46c8937 req-58a92154-3214-488c-b767-31e5fa3a4bdf service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state building and task_state spawning.
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-af6f0328-8dad-4ee4-b97a-0f1911aec9e9 req-7a347075-c253-4580-9943-673e9e331161 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-af6f0328-8dad-4ee4-b97a-0f1911aec9e9 req-7a347075-c253-4580-9943-673e9e331161 service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-af6f0328-8dad-4ee4-b97a-0f1911aec9e9 req-7a347075-c253-4580-9943-673e9e331161 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-af6f0328-8dad-4ee4-b97a-0f1911aec9e9 req-7a347075-c253-4580-9943-673e9e331161 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-af6f0328-8dad-4ee4-b97a-0f1911aec9e9 req-7a347075-c253-4580-9943-673e9e331161 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:52 user nova-compute[74534]: WARNING nova.compute.manager [req-af6f0328-8dad-4ee4-b97a-0f1911aec9e9 req-7a347075-c253-4580-9943-673e9e331161 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received unexpected event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with vm_state building and task_state spawning.
Nov 02 12:11:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-688afd0e-a36c-4ca2-a2a7-cdf89ef5bd91 req-db78bd91-c31a-4c30-b1ce-dd601838bd70 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-688afd0e-a36c-4ca2-a2a7-cdf89ef5bd91 req-db78bd91-c31a-4c30-b1ce-dd601838bd70 service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-688afd0e-a36c-4ca2-a2a7-cdf89ef5bd91 req-db78bd91-c31a-4c30-b1ce-dd601838bd70 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-688afd0e-a36c-4ca2-a2a7-cdf89ef5bd91 req-db78bd91-c31a-4c30-b1ce-dd601838bd70 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-688afd0e-a36c-4ca2-a2a7-cdf89ef5bd91 req-db78bd91-c31a-4c30-b1ce-dd601838bd70 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:11:54 user nova-compute[74534]: WARNING nova.compute.manager [req-688afd0e-a36c-4ca2-a2a7-cdf89ef5bd91 req-db78bd91-c31a-4c30-b1ce-dd601838bd70 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received unexpected event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with vm_state building and task_state spawning.
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:11:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance spawned successfully.
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: INFO nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Took 8.55 seconds to spawn the instance on the hypervisor.
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:11:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance spawned successfully.
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:11:54 user nova-compute[74534]: INFO nova.compute.manager [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Took 9.81 seconds to build instance.
Nov 02 12:11:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ca62f4d5-ed7e-4868-ba7a-db6b0891dbcd tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.916s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:54 user nova-compute[74534]: INFO nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Took 8.02 seconds to spawn the instance on the hypervisor.
Nov 02 12:11:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:11:54 user nova-compute[74534]: INFO nova.compute.manager [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Took 9.17 seconds to build instance.
Nov 02 12:11:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4e142f4-c50e-46cd-8c4e-4fa1ff67551c tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.354s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:11:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:11:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:11:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:11:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:11:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:11:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 is timed out.
Nov 02 12:12:04 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Successfully detached device vdb from instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 from the live domain config.
Nov 02 12:12:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VznQASrd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:12:04 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa9adca-0bbc-4d4b-8bf0-7e9a30e14d73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:12:04 user nova-compute[74534]: No targets found.
Nov 02 12:12:04 user nova-compute[74534]: iSNS:
Nov 02 12:12:04 user nova-compute[74534]: No targets found.
Nov 02 12:12:04 user nova-compute[74534]: STATIC:
Nov 02 12:12:04 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:12:04 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:12:04 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:12:04 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016
Nov 02 12:12:04 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:12:04 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:12:04 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:12:04 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:12:04 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:12:04 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2
Nov 02 12:12:04 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:12:04 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:12:04 user nova-compute[74534]: FIRMWARE:
Nov 02 12:12:04 user nova-compute[74534]: No targets found.
Nov 02 12:12:04 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:12:04 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:12:04 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0824db8e-468f-4eba-8cac-cd7e8ae08908]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc3788b-bd2f-468b-a46f-c35fac36b990]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:12:04 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1807625f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2'): ({'sdh'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Removing single pathed devices sdh {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fa4685-814e-4634-b9d0-f1c7f395ebb4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a37f7-82d1-4f3c-a7a8-977e69c43256]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Flushing IO for device /dev/sdh {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[059a0e43-273a-4d5b-a32d-d7b9a98d0882]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73a8c3c-084a-4347-ba79-d59379f8a572]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] SCSI volumes sdh have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b6195f-030d-4d8a-87d4-e20de13e763a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c9cd5e-9222-4689-ae16-9cea12a49e2d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260]
Nov 02 12:12:04 user nova-compute[74534]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2, portal: 172.16.0.220,3260] successful.
Nov 02 12:12:04 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58ba8952-292f-4352-9cdf-ecaec6db2af2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b562a2-0dd5-46f6-a0b8-e96162329271]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] <== disconnect_volume: return (470ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:05 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'flavor' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:12:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:12:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:12:05 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7479MB free_disk=25.197914123535156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:12:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2916efb5-21b2-4ea0-ba81-2544c7a5c2f5 tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.550s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c7d59af9-1ab5-43b4-84af-3a27cd182e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 68f79d06-363a-44d0-a74a-4c745558f0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance a9159e85-6d12-4166-be94-8f8b1620761a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-changed-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Refreshing instance network info cache due to event network-changed-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] Acquiring lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] Acquired lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Refreshing network info cache for port 21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lazy-loading 'flavor' on Instance uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:11 user nova-compute[74534]: INFO nova.compute.manager [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Attaching volume 0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d to /dev/vdb
Nov 02 12:12:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updated VIF entry in instance network info cache for port 21a2de97-57de-4c7e-ac4d-0d91cc3fcd92. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updating instance_info_cache with network_info: [{"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG os_brick.utils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-358994f6-778b-4903-908d-ce0c81323b67 req-68f1caf5-3abd-44a3-ba67-138e1337f90e service nova] Releasing lock "refresh_cache-68f79d06-363a-44d0-a74a-4c745558f0ea" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db7dcc-8bad-49e1-a990-b9722a64d9c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ca2b1c-1dff-4a05-9006-0d9bac2779cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aa53e7-df56-4bfc-a172-882f2d7ec14d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e74da32-683c-4645-a38d-067565c00f4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:12:11 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:12:11 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[645d1e67-5b11-4d7b-b1b3-176bb95a34ac]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG os_brick.utils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:12:11 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updating existing volume attachment record: 5a103ed9-6447-412e-8d27-6d41c8244040 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:12:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:12:18 user nova-compute[74534]: INFO nova.compute.claims [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Claim successful on node user
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.network.neutron [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:12:18 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:12:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG nova.policy [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cb6a67fcb13459880727c825793db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcb68ce88ae4280ba6feb308b7c53da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:12:19 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Creating image(s)
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "/opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.220s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk 1073741824" returned: 0 in 0.052s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG nova.network.neutron [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Successfully created port: 0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.220s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:12:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Cannot resize image /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Ensure instance console log exists: /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.neutron [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Successfully updated port: 0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquired lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.neutron [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-changed-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Refreshing instance network info cache due to event network-changed-0318df0b-b216-408e-92a9-92ac03bb706c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] Acquiring lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.neutron [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.neutron [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Updating instance_info_cache with network_info: [{"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Releasing lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Instance network_info: |[{"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] Acquired lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.neutron [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Refreshing network info cache for port 0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Start _get_guest_xml network_info=[{"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:12:20 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:12:20 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78868070',display_name='tempest-AttachVolumeNegativeTest-server-78868070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78868070',id=22,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1QZfbh+6UifquvndrOMGMjvHQcAIi5pj+ghV9KS4eo/3ySJvZS5meYuvNfQdhBZa7D41JwEqYTFl/l4ALeFmGDVguTA9Ufh0CtA+6oMmP43hPRfwnB5LfLgH0DpinRVQ==',key_name='tempest-keypair-157203503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-wbydw8kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=734e86fe-b5c9-4c17-a360-fc7b7999b0bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ac:fb,bridge_name='br-int',has_traffic_filtering=True,id=0318df0b-b216-408e-92a9-92ac03bb706c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318df0b-b2') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.objects.instance [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'pci_devices' on Instance uuid 734e86fe-b5c9-4c17-a360-fc7b7999b0bc {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:12:20 user nova-compute[74534]:   <uuid>734e86fe-b5c9-4c17-a360-fc7b7999b0bc</uuid>
Nov 02 12:12:20 user nova-compute[74534]:   <name>instance-00000016</name>
Nov 02 12:12:20 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:12:20 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:12:20 user nova-compute[74534]:   <metadata>
Nov 02 12:12:20 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:12:20 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:12:20 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeNegativeTest-server-78868070</nova:name>
Nov 02 12:12:20 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:12:20</nova:creationTime>
Nov 02 12:12:20 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:12:20 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:12:20 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:12:20 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:12:20 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:12:20 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:12:20 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:12:20 user nova-compute[74534]:       <nova:owner>
Nov 02 12:12:20 user nova-compute[74534]:         <nova:user uuid="3cb6a67fcb13459880727c825793db65">tempest-AttachVolumeNegativeTest-322425016-project-member</nova:user>
Nov 02 12:12:20 user nova-compute[74534]:         <nova:project uuid="8fcb68ce88ae4280ba6feb308b7c53da">tempest-AttachVolumeNegativeTest-322425016</nova:project>
Nov 02 12:12:20 user nova-compute[74534]:       </nova:owner>
Nov 02 12:12:20 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:12:20 user nova-compute[74534]:       <nova:ports>
Nov 02 12:12:20 user nova-compute[74534]:         <nova:port uuid="0318df0b-b216-408e-92a9-92ac03bb706c">
Nov 02 12:12:20 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 12:12:20 user nova-compute[74534]:         </nova:port>
Nov 02 12:12:20 user nova-compute[74534]:       </nova:ports>
Nov 02 12:12:20 user nova-compute[74534]:     </nova:instance>
Nov 02 12:12:20 user nova-compute[74534]:   </metadata>
Nov 02 12:12:20 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:12:20 user nova-compute[74534]:     <system>
Nov 02 12:12:20 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:12:20 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:12:20 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:12:20 user nova-compute[74534]:       <entry name="serial">734e86fe-b5c9-4c17-a360-fc7b7999b0bc</entry>
Nov 02 12:12:20 user nova-compute[74534]:       <entry name="uuid">734e86fe-b5c9-4c17-a360-fc7b7999b0bc</entry>
Nov 02 12:12:20 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:12:20 user nova-compute[74534]:     </system>
Nov 02 12:12:20 user nova-compute[74534]:   </sysinfo>
Nov 02 12:12:20 user nova-compute[74534]:   <os>
Nov 02 12:12:20 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:12:20 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:12:20 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:12:20 user nova-compute[74534]:   </os>
Nov 02 12:12:20 user nova-compute[74534]:   <features>
Nov 02 12:12:20 user nova-compute[74534]:     <acpi/>
Nov 02 12:12:20 user nova-compute[74534]:     <apic/>
Nov 02 12:12:20 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:12:20 user nova-compute[74534]:   </features>
Nov 02 12:12:20 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:12:20 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:12:20 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:12:20 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:12:20 user nova-compute[74534]:   </clock>
Nov 02 12:12:20 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:12:20 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:12:20 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:12:20 user nova-compute[74534]:   </cpu>
Nov 02 12:12:20 user nova-compute[74534]:   <devices>
Nov 02 12:12:20 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:12:20 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:12:20 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk"/>
Nov 02 12:12:20 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:12:20 user nova-compute[74534]:     </disk>
Nov 02 12:12:20 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:12:20 user nova-compute[74534]:       <mac address="fa:16:3e:44:ac:fb"/>
Nov 02 12:12:20 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:12:20 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:12:20 user nova-compute[74534]:       <target dev="tap0318df0b-b2"/>
Nov 02 12:12:20 user nova-compute[74534]:     </interface>
Nov 02 12:12:20 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:12:20 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/console.log" append="off"/>
Nov 02 12:12:20 user nova-compute[74534]:     </serial>
Nov 02 12:12:20 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:12:20 user nova-compute[74534]:     <video>
Nov 02 12:12:20 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:12:20 user nova-compute[74534]:     </video>
Nov 02 12:12:20 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:12:20 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:12:20 user nova-compute[74534]:     </rng>
Nov 02 12:12:20 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:12:20 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:12:20 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:12:20 user nova-compute[74534]:     </memballoon>
Nov 02 12:12:20 user nova-compute[74534]:   </devices>
Nov 02 12:12:20 user nova-compute[74534]: </domain>
Nov 02 12:12:20 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78868070',display_name='tempest-AttachVolumeNegativeTest-server-78868070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78868070',id=22,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1QZfbh+6UifquvndrOMGMjvHQcAIi5pj+ghV9KS4eo/3ySJvZS5meYuvNfQdhBZa7D41JwEqYTFl/l4ALeFmGDVguTA9Ufh0CtA+6oMmP43hPRfwnB5LfLgH0DpinRVQ==',key_name='tempest-keypair-157203503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-wbydw8kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=734e86fe-b5c9-4c17-a360-fc7b7999b0bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ac:fb,bridge_name='br-int',has_traffic_filtering=True,id=0318df0b-b216-408e-92a9-92ac03bb706c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318df0b-b2') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG os_vif [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ac:fb,bridge_name='br-int',has_traffic_filtering=True,id=0318df0b-b216-408e-92a9-92ac03bb706c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318df0b-b2') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a360d0d-dcf6-5214-b732-a8c86a9576bd', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0318df0b-b2, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0318df0b-b2, col_values=(('qos', UUID('9d645a7e-0fbb-45b5-99a0-08ac6b971f1e')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0318df0b-b2, col_values=(('external_ids', {'iface-id': '0318df0b-b216-408e-92a9-92ac03bb706c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:ac:fb', 'vm-uuid': '734e86fe-b5c9-4c17-a360-fc7b7999b0bc'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:12:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:20 user nova-compute[74534]: INFO os_vif [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ac:fb,bridge_name='br-int',has_traffic_filtering=True,id=0318df0b-b216-408e-92a9-92ac03bb706c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318df0b-b2')
Nov 02 12:12:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:12:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No VIF found with MAC fa:16:3e:44:ac:fb, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:12:21 user nova-compute[74534]: DEBUG nova.network.neutron [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Updated VIF entry in instance network info cache for port 0318df0b-b216-408e-92a9-92ac03bb706c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:12:21 user nova-compute[74534]: DEBUG nova.network.neutron [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Updating instance_info_cache with network_info: [{"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:12:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-161aec78-f13e-44e6-a89b-d98ccaf977d4 req-e77bc9b2-e135-4164-9fac-f04a6135b5bd service nova] Releasing lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-51b80c2a-51f8-4422-86d8-e50498663510 req-3b84a05d-18a1-41d3-887d-0b913cbdab68 service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51b80c2a-51f8-4422-86d8-e50498663510 req-3b84a05d-18a1-41d3-887d-0b913cbdab68 service nova] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51b80c2a-51f8-4422-86d8-e50498663510 req-3b84a05d-18a1-41d3-887d-0b913cbdab68 service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-51b80c2a-51f8-4422-86d8-e50498663510 req-3b84a05d-18a1-41d3-887d-0b913cbdab68 service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-51b80c2a-51f8-4422-86d8-e50498663510 req-3b84a05d-18a1-41d3-887d-0b913cbdab68 service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] No waiting events found dispatching network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:12:22 user nova-compute[74534]: WARNING nova.compute.manager [req-51b80c2a-51f8-4422-86d8-e50498663510 req-3b84a05d-18a1-41d3-887d-0b913cbdab68 service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received unexpected event network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c for instance with vm_state building and task_state spawning.
Nov 02 12:12:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-32cab64d-2786-4540-a5a4-be368a636f1a req-289242a7-7367-4387-be8c-28479fbb10e7 service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-32cab64d-2786-4540-a5a4-be368a636f1a req-289242a7-7367-4387-be8c-28479fbb10e7 service nova] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-32cab64d-2786-4540-a5a4-be368a636f1a req-289242a7-7367-4387-be8c-28479fbb10e7 service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-32cab64d-2786-4540-a5a4-be368a636f1a req-289242a7-7367-4387-be8c-28479fbb10e7 service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-32cab64d-2786-4540-a5a4-be368a636f1a req-289242a7-7367-4387-be8c-28479fbb10e7 service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] No waiting events found dispatching network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:12:24 user nova-compute[74534]: WARNING nova.compute.manager [req-32cab64d-2786-4540-a5a4-be368a636f1a req-289242a7-7367-4387-be8c-28479fbb10e7 service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received unexpected event network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c for instance with vm_state building and task_state spawning.
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:12:25 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Instance spawned successfully.
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:12:25 user nova-compute[74534]: INFO nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 02 12:12:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:12:25 user nova-compute[74534]: INFO nova.compute.manager [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Took 7.19 seconds to build instance.
Nov 02 12:12:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-34255974-13e1-435d-ba63-7ec76d2148b4 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.344s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-changed-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Refreshing instance network info cache due to event network-changed-1f4bee35-a830-4a42-bd66-801b00ae8d73. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] Acquiring lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] Acquired lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Refreshing network info cache for port 1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updated VIF entry in instance network info cache for port 1f4bee35-a830-4a42-bd66-801b00ae8d73. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updating instance_info_cache with network_info: [{"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:12:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c2d98883-526b-4a75-8dd5-1d8720f289b5 req-edd836f9-5c5e-4c49-97ed-b840174f3114 service nova] Releasing lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:12:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:34 user nova-compute[74534]: INFO nova.compute.manager [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Terminating instance
Nov 02 12:12:34 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-4c767287-1e9b-4eeb-8cdb-ba143d428d6f req-bfd1f26b-9ea6-4b58-b879-500de8d082e4 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4c767287-1e9b-4eeb-8cdb-ba143d428d6f req-bfd1f26b-9ea6-4b58-b879-500de8d082e4 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4c767287-1e9b-4eeb-8cdb-ba143d428d6f req-bfd1f26b-9ea6-4b58-b879-500de8d082e4 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4c767287-1e9b-4eeb-8cdb-ba143d428d6f req-bfd1f26b-9ea6-4b58-b879-500de8d082e4 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-4c767287-1e9b-4eeb-8cdb-ba143d428d6f req-bfd1f26b-9ea6-4b58-b879-500de8d082e4 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:12:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-4c767287-1e9b-4eeb-8cdb-ba143d428d6f req-bfd1f26b-9ea6-4b58-b879-500de8d082e4 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-unplugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:12:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Instance destroyed successfully.
Nov 02 12:12:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lazy-loading 'resources' on Instance uuid c7d59af9-1ab5-43b4-84af-3a27cd182e29 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-480445214',display_name='tempest-ServerStableDeviceRescueTest-server-480445214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-480445214',id=6,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdGCJP5nBWInjL/LmHQ0hFRZI4+zAHfsMY/eQ8JRXS8qeH39DzGK8bEZMtTDdEaZ8ykLyjLAanmn0+y2XCypb1IU5QvNEkiyzrDTZJsvCN9KG+79zach52DWPhIgS2JIg==',key_name='tempest-keypair-1756371081',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:09:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ca53e8b45e248c8accd59e5d57e4fbc',ramdisk_id='',reservation_id='r-1sn0qowx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1725617346',owner_user_name='tempest-ServerStableDeviceRescueTest-1725617346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e552c4c23df4919957749b5a4b1447d',uuid=c7d59af9-1ab5-43b4-84af-3a27cd182e29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converting VIF {"id": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "address": "fa:16:3e:eb:98:c7", "network": {"id": "9ca71074-fb3b-418a-82b0-738c5f3242b7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1407411373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca53e8b45e248c8accd59e5d57e4fbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape87382cc-97", "ovs_interfaceid": "e87382cc-9797-48c4-b9b7-eaf7c1d85ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_vif [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape87382cc-97, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fa73ee0-893d-4587-9a0a-47b371314af1) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:35 user nova-compute[74534]: INFO os_vif [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:98:c7,bridge_name='br-int',has_traffic_filtering=True,id=e87382cc-9797-48c4-b9b7-eaf7c1d85ea2,network=Network(9ca71074-fb3b-418a-82b0-738c5f3242b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape87382cc-97')
Nov 02 12:12:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Deleting instance files /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29_del
Nov 02 12:12:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Deletion of /opt/stack/data/nova/instances/c7d59af9-1ab5-43b4-84af-3a27cd182e29_del complete
Nov 02 12:12:35 user nova-compute[74534]: INFO nova.compute.manager [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:12:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:12:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:12:35 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc8b0b-7af1-45a8-a3e4-13227fc8b427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:12:35 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc765d31-c2fd-44dc-b9f6-211b38930084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d] added
Nov 02 12:12:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d36586-0c1f-4ccc-933f-78415adddc85]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e96dc-6bfb-4efb-86fc-6140fc5d3347]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YroTkOBc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YroTkOBc" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13b3c0-f1a6-4050-8e3d-1325c163fd21]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YroTkOBc'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726f977-9abf-461b-bee5-9b02ce83ba60]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace0b4b-b95e-4ae2-8f02-33887e1e0fec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:12:35 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:12:35 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:12:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:12:35 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:12:35 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:12:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c2085-3275-468b-920e-0a5ada425eb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]
Nov 02 12:12:35 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.
Nov 02 12:12:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a31250-a3f7-4614-ae39-b8489e2d506c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:12:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ac6af-864e-4340-ba2d-54dcf7d5a151]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:12:36 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:12:36 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:12:36 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:12:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:12:36 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:12:36 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:12:36 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:12:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.033s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c6c3f6-f023-40f3-b116-4ae86969bc13]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:12:36 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Took 1.00 seconds to deallocate network for instance.
Nov 02 12:12:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-9a34f06c-82e8-4d83-8cf8-6833722b162d req-b6c4c23f-91e6-42e8-80c1-a58bc2a6050f service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-deleted-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-76169b26-2bcd-43f4-9e12-1752d734497d req-3d340a78-2a2e-411f-8a82-e3c72e4dd954 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-76169b26-2bcd-43f4-9e12-1752d734497d req-3d340a78-2a2e-411f-8a82-e3c72e4dd954 service nova] Acquiring lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-76169b26-2bcd-43f4-9e12-1752d734497d req-3d340a78-2a2e-411f-8a82-e3c72e4dd954 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-76169b26-2bcd-43f4-9e12-1752d734497d req-3d340a78-2a2e-411f-8a82-e3c72e4dd954 service nova] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-76169b26-2bcd-43f4-9e12-1752d734497d req-3d340a78-2a2e-411f-8a82-e3c72e4dd954 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] No waiting events found dispatching network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:12:36 user nova-compute[74534]: WARNING nova.compute.manager [req-76169b26-2bcd-43f4-9e12-1752d734497d req-3d340a78-2a2e-411f-8a82-e3c72e4dd954 service nova] [instance: c7d59af9-1ab5-43b4-84af-3a27cd182e29] Received unexpected event network-vif-plugged-e87382cc-9797-48c4-b9b7-eaf7c1d85ea2 for instance with vm_state deleted and task_state None.
Nov 02 12:12:36 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:12:36 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26539386236363962', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539386236363962', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lazy-loading 'flavor' on Instance uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:12:37 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:12:37 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:12:37 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:12:37 user nova-compute[74534]:   <serial>0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d</serial>
Nov 02 12:12:37 user nova-compute[74534]: </disk>
Nov 02 12:12:37 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:12:37 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Deleted allocations for instance c7d59af9-1ab5-43b4-84af-3a27cd182e29
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83ccc681-4426-4a9d-a0a0-3b6516545b3e tempest-ServerStableDeviceRescueTest-1725617346 tempest-ServerStableDeviceRescueTest-1725617346-project-member] Lock "c7d59af9-1ab5-43b4-84af-3a27cd182e29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lazy-loading 'flavor' on Instance uuid e20af21c-b63b-4fd2-b4f3-8ca800894ea9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] No VIF found with MAC fa:16:3e:e9:ab:e7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:37 user nova-compute[74534]: INFO nova.compute.manager [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Attaching volume 6e983995-3b89-4758-8650-bf7301b27707 to /dev/vdb
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bedd17b3-5fca-4a96-88e8-7fb258c9ad66 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.180s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.utils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda0ac08-90f8-47e6-92aa-95c9fa160498]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1bca66-8bb0-4e8c-83f3-8a9fafb60304]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4317b5c0-c285-43b7-b8f1-f0246c7f2ecc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[69906821-3a78-4bd8-b787-e83584c05044]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:12:37 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:12:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3ea8ac-ea1c-47d3-a5ef-cdda7d2e1c44]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG os_brick.utils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:12:37 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updating existing volume attachment record: 61bc7af1-53db-479b-a561-8fd067bfa325 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:12:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG os_brick.utils [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff15e73-2c6e-4c2b-9e71-0ffd37ff6427]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[632069c8-dee7-42d4-93d6-9696b346e77a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[736856b5-f7e6-4f03-8745-5c552612a354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2133d0-95d4-46cb-b49a-7e4fe83dfdbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:12:39 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:12:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac0739-8e5d-4329-9bab-9199ec16f6b6]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:12:39 user nova-compute[74534]: DEBUG os_brick.utils [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:12:39 user nova-compute[74534]: INFO nova.compute.manager [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Swapping volume 0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d for d9481ee1-d218-4445-ba35-69bd0997c27b
Nov 02 12:12:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:57 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-changed-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Refreshing instance network info cache due to event network-changed-3704c8b5-ecf1-441a-8c0e-9219f2e12835. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] Acquiring lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] Acquired lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:12:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Refreshing network info cache for port 3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 3390f6a1-9306-42a3-af5a-b26e113c0b08 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updated VIF entry in instance network info cache for port 3704c8b5-ecf1-441a-8c0e-9219f2e12835. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updating instance_info_cache with network_info: [{"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e21f4af3-cbd9-4fd2-b6b4-7683572e51ca req-121d2755-4cfc-41e4-a664-fb068c470844 service nova] Releasing lock "refresh_cache-a9159e85-6d12-4166-be94-8f8b1620761a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updating instance_info_cache with network_info: [{"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:12:59 user nova-compute[74534]: INFO nova.compute.manager [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Rebuilding instance
Nov 02 12:12:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-4607b098-19e1-470c-b8be-15c13a4c386b req-42e58a4c-f108-48d2-bc30-a04ac0acda4f service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-unplugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4607b098-19e1-470c-b8be-15c13a4c386b req-42e58a4c-f108-48d2-bc30-a04ac0acda4f service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4607b098-19e1-470c-b8be-15c13a4c386b req-42e58a4c-f108-48d2-bc30-a04ac0acda4f service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4607b098-19e1-470c-b8be-15c13a4c386b req-42e58a4c-f108-48d2-bc30-a04ac0acda4f service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-4607b098-19e1-470c-b8be-15c13a4c386b req-42e58a4c-f108-48d2-bc30-a04ac0acda4f service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-unplugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:00 user nova-compute[74534]: WARNING nova.compute.manager [req-4607b098-19e1-470c-b8be-15c13a4c386b req-42e58a4c-f108-48d2-bc30-a04ac0acda4f service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received unexpected event network-vif-unplugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with vm_state active and task_state rebuilding.
Nov 02 12:13:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance destroyed successfully.
Nov 02 12:13:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance destroyed successfully.
Nov 02 12:13:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1445971962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718226071',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUvT97WEExqR0OQmGwpmELMt+ImPLb1+mXmovwHR4XLPFB0ez6vAOasZmSPO2WheLOO9pmkHuFYo38fre1rCWoG3U01qW0dS1//or12B5d7TtxG9aJO7yiW6xIGkwXZog==',key_name='tempest-keypair-1558372433',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d863bade99ab4f4e946637975a0f7224',ramdisk_id='',reservation_id='r-pec8wqms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1315298848',owner_user_name='tempest-ServerActionsV293TestJSON-1315298848-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3db2c5117c754142978c7a872de22fb4',uuid=a9159e85-6d12-4166-be94-8f8b1620761a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converting VIF {"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG os_vif [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3704c8b5-ec, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10007a99-27d5-4d85-b921-f8625f31897f) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:00 user nova-compute[74534]: INFO os_vif [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec')
Nov 02 12:13:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:00 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:13:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59edd72d-1717-4430-bc0b-34eb8219ef8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:13:01 user nova-compute[74534]: No targets found.
Nov 02 12:13:01 user nova-compute[74534]: iSNS:
Nov 02 12:13:01 user nova-compute[74534]: No targets found.
Nov 02 12:13:01 user nova-compute[74534]: STATIC:
Nov 02 12:13:01 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:13:01 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:01 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:01 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016
Nov 02 12:13:01 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:01 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:01 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:13:01 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:01 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:01 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:13:01 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:01 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:01 user nova-compute[74534]: FIRMWARE:
Nov 02 12:13:01 user nova-compute[74534]: No targets found.
Nov 02 12:13:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:13:01 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:13:01 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba94e7-afb1-4f81-a5d1-4d9e28c17059]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f3c19-a2f0-4690-af8a-6c0c3e3f0e7e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1983141f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[29929210-f60d-43bb-81c7-2f058a3e4d1c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a865c12-d988-4707-8b25-99fd64e8fe93]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb4bbf0-99c5-45c3-8395-565b9b0f4ef2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafc5692-6687-4fd0-82e2-2393ba8b5015]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4794fe17', '/dev/disk/by-id/scsi-1SCST_BIO4794fe17-5179435c51e8a5c3', '/dev/disk/by-id/scsi-23531373934333563') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef410c99-e12a-4f50-abdf-e1120c53d598]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cff4fa-9279-4041-a8df-22edf971f3a9]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a0a762-06e0-4adf-9497-ca495c9aab71]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]
Nov 02 12:13:01 user nova-compute[74534]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.
Nov 02 12:13:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fbe902-a25d-41b0-8e93-43e7eaaee4b0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] <== disconnect_volume: return (346ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:13:01 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Deleting instance files /opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a_del
Nov 02 12:13:01 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Deletion of /opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a_del complete
Nov 02 12:13:01 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a9159e85-6d12-4166-be94-8f8b1620761a could not be found.
Nov 02 12:13:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:01 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d07c8-6177-43c5-9363-4ad4b5889a86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:13:01 user nova-compute[74534]: No targets found.
Nov 02 12:13:01 user nova-compute[74534]: iSNS:
Nov 02 12:13:01 user nova-compute[74534]: No targets found.
Nov 02 12:13:01 user nova-compute[74534]: STATIC:
Nov 02 12:13:01 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:13:01 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:01 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:01 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:13:01 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:01 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:01 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:13:01 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:01 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:01 user nova-compute[74534]: FIRMWARE:
Nov 02 12:13:01 user nova-compute[74534]: No targets found.
Nov 02 12:13:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:13:01 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:13:01 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5b945a-b6c3-42ec-ad5c-53b0596b41e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPqTygtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:01 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6268bccb-7e30-4c69-8997-3de3cb9b5390]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:01 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1807c8d30>, {}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Disconnecting from: [] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] <== disconnect_volume: return (78ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:01 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:01 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5dda9-6c2d-4a2e-953c-1ff82dd73a9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:13:01 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.051s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df104a0-6bb1-4035-b2a9-2c8aae589a4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707] added
Nov 02 12:13:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[30763da7-06df-420a-bffc-844b325742f8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ba101-47c3-4ef9-bb9a-9066a630b366]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPqTygtb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPqTygtb" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5060c9d-20bb-467c-957a-db7772d2e133]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPqTygtb'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[736cb2fa-3bd8-4dd6-a284-419eb3d765d4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[809cd149-f3aa-4a8b-a3a4-3d9826271d64]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f6c28-8922-48e1-bc31-44fe14f3df6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260]
Nov 02 12:13:02 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260] successful.
Nov 02 12:13:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[925d6cdc-892d-4b8f-ae59-decab8ea2956]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bf9a24-eca8-460b-ae91-1686d7e9d279]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:02 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b25265-c02e-424d-97d7-8b3b919fe678]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPqTygtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-2f266969-94e8-4c2f-831b-ae48322f2755 req-23bdefe2-9aef-4474-9fc3-b3f39dcdf6f5 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2f266969-94e8-4c2f-831b-ae48322f2755 req-23bdefe2-9aef-4474-9fc3-b3f39dcdf6f5 service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2f266969-94e8-4c2f-831b-ae48322f2755 req-23bdefe2-9aef-4474-9fc3-b3f39dcdf6f5 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2f266969-94e8-4c2f-831b-ae48322f2755 req-23bdefe2-9aef-4474-9fc3-b3f39dcdf6f5 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-2f266969-94e8-4c2f-831b-ae48322f2755 req-23bdefe2-9aef-4474-9fc3-b3f39dcdf6f5 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:02 user nova-compute[74534]: WARNING nova.compute.manager [req-2f266969-94e8-4c2f-831b-ae48322f2755 req-23bdefe2-9aef-4474-9fc3-b3f39dcdf6f5 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received unexpected event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with vm_state active and task_state rebuilding.
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Preparing to wait for external event volume-reimaged-23064b31-3e27-4c42-85d0-0cc2fe4ba016 {{(pid=74534) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQByePkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68f79d06-363a-44d0-a74a-4c745558f0ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9481ee1-d218-4445-ba35-69bd0997c27b', 'serial': 'd9481ee1-d218-4445-ba35-69bd0997c27b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '68f79d06-363a-44d0-a74a-4c745558f0ea', 'attached_at': '', 'detached_at': '', 'volume_id': '0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'serial'} {{(pid=74534) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQByePkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:03 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23635623433313731', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635623433313731', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.162s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:03 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:03 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lazy-loading 'flavor' on Instance uuid e20af21c-b63b-4fd2-b4f3-8ca800894ea9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[736f1a00-8427-4ff6-804c-8415ee64167c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:13:03 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:13:03 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:13:03 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:13:03 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:13:03 user nova-compute[74534]:   <serial>6e983995-3b89-4758-8650-bf7301b27707</serial>
Nov 02 12:13:03 user nova-compute[74534]: </disk>
Nov 02 12:13:03 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e802b9-de24-4235-a0c7-3e93216e83d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b] added
Nov 02 12:13:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98904c3-0aec-4436-9aaa-9f08e25ace1b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cbe83b-9e62-4cf3-8770-7d564342b90d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQByePkh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQByePkh" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb5bf5-9bd7-4b47-82c7-182bbea64d0f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GQByePkh'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f3e14d-9510-46c0-99c5-16ec51cc3535]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8229cff-74d8-431d-b2cf-8331a6d47b89]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd9c377-2db7-4eec-b2b3-108a8e5fd33f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260]
Nov 02 12:13:03 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260] successful.
Nov 02 12:13:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[316639e3-d19d-4760-b2cc-95fd58832b24]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d960c-c210-4e77-b425-ceea13627152]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:03 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a1f2a1-e4bf-4bc6-8149-1803f303e750]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQByePkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] No VIF found with MAC fa:16:3e:f9:54:3d, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a32dd863-8a63-4a88-a534-5b7e41e73460 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.362s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] <== connect_volume: return (1576ms) {'type': 'block', 'scsi_wwn': '23439323138623663', 'path': '/dev/sdf'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439323138623663', 'path': '/dev/sdf'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG nova.objects.instance [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lazy-loading 'flavor' on Instance uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:13:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:05 user nova-compute[74534]: INFO nova.compute.manager [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Detaching volume 6e983995-3b89-4758-8650-bf7301b27707
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:05 user nova-compute[74534]: INFO nova.virt.block_device [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Attempting to driver detach volume 6e983995-3b89-4758-8650-bf7301b27707 from mountpoint /dev/vdb
Nov 02 12:13:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Attempting to detach device vdb from instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:13:05 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:13:05 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:13:05 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:13:05 user nova-compute[74534]:   <serial>6e983995-3b89-4758-8650-bf7301b27707</serial>
Nov 02 12:13:05 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:13:05 user nova-compute[74534]: </disk>
Nov 02 12:13:05 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:13:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Successfully detached device vdb from instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 from the persistent domain config.
Nov 02 12:13:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:13:05 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:13:05 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:13:05 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:13:05 user nova-compute[74534]:   <serial>6e983995-3b89-4758-8650-bf7301b27707</serial>
Nov 02 12:13:05 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:13:05 user nova-compute[74534]: </disk>
Nov 02 12:13:05 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:13:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 352321536 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:13:07 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:07 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7515MB free_disk=25.1905517578125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 620756992 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 68f79d06-363a-44d0-a74a-4c745558f0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance a9159e85-6d12-4166-be94-8f8b1620761a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 768606208 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:13:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.754s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 910163968 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 1044381696 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:08 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:08 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:09 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5d3a99-0126-4bf9-a833-257e1769dff3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:13:09 user nova-compute[74534]: No targets found.
Nov 02 12:13:09 user nova-compute[74534]: iSNS:
Nov 02 12:13:09 user nova-compute[74534]: No targets found.
Nov 02 12:13:09 user nova-compute[74534]: STATIC:
Nov 02 12:13:09 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:13:09 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:09 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:09 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b
Nov 02 12:13:09 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:09 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:09 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:13:09 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:09 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:09 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707
Nov 02 12:13:09 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:09 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:09 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:13:09 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:09 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:09 user nova-compute[74534]: FIRMWARE:
Nov 02 12:13:09 user nova-compute[74534]: No targets found.
Nov 02 12:13:09 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:13:09 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:13:09 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[931cfa17-a320-446a-b39b-344d46dc1ca6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fdce80-c645-47f2-98d9-fd39d6eb5108]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:09 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:09 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:09 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c64e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae68794-b577-4ce3-9da8-c42ad164d8dd]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7099016e-3cbc-4451-88f2-42e100cab711]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac47a26-7a5b-44b7-862b-dae5be4ebd3f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[372213e4-0f4c-4949-9cb8-95f3d2d46a10]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983c01b-47c2-4aa1-ac67-402fb1be8b24]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c534ea-46eb-4e14-9d57-afc5f6970f74]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]
Nov 02 12:13:09 user nova-compute[74534]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.
Nov 02 12:13:09 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a14567-4ad8-47fb-b4e4-6c611e489609]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] <== disconnect_volume: return (324ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQByePkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '68f79d06-363a-44d0-a74a-4c745558f0ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9481ee1-d218-4445-ba35-69bd0997c27b', 'serial'} {{(pid=74534) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Nov 02 12:13:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] swap_volume: removing Cinder connection for volume 0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d {{(pid=74534) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Nov 02 12:13:10 user nova-compute[74534]: DEBUG nova.compute.manager [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] swap_volume: Updating volume 0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "GQByePkh", "auth_password": "nb2NTSV8DvC09p", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "d9481ee1-d218-4445-ba35-69bd0997c27b"}, "status": "reserved", "instance": "68f79d06-363a-44d0-a74a-4c745558f0ea", "attached_at": "", "detached_at": "", "volume_id": "d9481ee1-d218-4445-ba35-69bd0997c27b", "serial": "d9481ee1-d218-4445-ba35-69bd0997c27b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd9481ee1-d218-4445-ba35-69bd0997c27b', 'no_device': None, 'attachment_id': 'f80390b2-b575-4677-8781-47980ec67c62'} {{(pid=74534) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Nov 02 12:13:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-63483d6e-f455-44d1-9199-b0e1f676ea9b tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.380s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG os_brick.utils [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a6da4c-5fdc-48d3-8f6d-3629043da827]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de1d38-1615-40d1-b707-4548f36a8e2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a766364a-1209-4ae4-9e83-b1e750aacf3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038cd93-37f0-4fd8-bfaa-e00179849cdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:13:12 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:13:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b3d4a0-ecb2-42ce-aafd-19bd860e97a7]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:13:12 user nova-compute[74534]: DEBUG os_brick.utils [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:12 user nova-compute[74534]: INFO nova.compute.manager [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Swapping volume d9481ee1-d218-4445-ba35-69bd0997c27b for 0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:13:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 is timed out.
Nov 02 12:13:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Successfully detached device vdb from instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 from the live domain config.
Nov 02 12:13:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPqTygtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:26 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d752e14-d914-41c8-aed7-772af076fa8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:13:26 user nova-compute[74534]: No targets found.
Nov 02 12:13:26 user nova-compute[74534]: iSNS:
Nov 02 12:13:26 user nova-compute[74534]: No targets found.
Nov 02 12:13:26 user nova-compute[74534]: STATIC:
Nov 02 12:13:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:13:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b
Nov 02 12:13:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707
Nov 02 12:13:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:13:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:26 user nova-compute[74534]: FIRMWARE:
Nov 02 12:13:26 user nova-compute[74534]: No targets found.
Nov 02 12:13:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:13:26 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:13:26 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0fb1dd-a555-4a1e-be2b-d050aa0a0a48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[01145948-5d53-4ab5-bd82-2c12bc693381]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:26 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:26 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:26 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:26 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:26 user nova-compute[74534]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 (non-flash)
Nov 02 12:13:26 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1804c6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad29b0a-ddf9-4ff9-987e-69fc6056c8e6]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bf8ddd-5e99-4492-a6e7-23852c2d9321]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac8e10-a53a-46d2-9339-b01f714ecb99]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[af68a0c6-8fd1-4e3e-965a-cc74ffa6f043]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba97c4-1036-40f7-a0ab-cc23562d140f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08963168-9a91-4e9f-b47a-f94c9abd37d4]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260]
Nov 02 12:13:26 user nova-compute[74534]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707, portal: 172.16.0.220,3260] successful.
Nov 02 12:13:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e983995-3b89-4758-8650-bf7301b27707 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31cbdde-66b7-4620-9038-8623a25a5947]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] <== disconnect_volume: return (397ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:13:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:27 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lazy-loading 'flavor' on Instance uuid e20af21c-b63b-4fd2-b4f3-8ca800894ea9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d58a4623-bd4c-4def-882f-06d36c714645 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.316s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:13:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:13:32 user nova-compute[74534]: INFO nova.compute.claims [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Claim successful on node user
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:13:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.policy [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'caf5cde0e75e444da00c7bcda4bcdd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ccb20fcd184ecebd3707d9d93c8817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:13:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Creating image(s)
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "/opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk 1073741824" returned: 0 in 0.053s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Successfully created port: c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.210s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Cannot resize image /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Ensure instance console log exists: /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Successfully updated port: c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-724f27de-2b8b-4bed-9509-a7b358a0f12e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-724f27de-2b8b-4bed-9509-a7b358a0f12e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received event network-changed-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Refreshing instance network info cache due to event network-changed-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] Acquiring lock "refresh_cache-724f27de-2b8b-4bed-9509-a7b358a0f12e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:13:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Updating instance_info_cache with network_info: [{"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-724f27de-2b8b-4bed-9509-a7b358a0f12e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Instance network_info: |[{"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] Acquired lock "refresh_cache-724f27de-2b8b-4bed-9509-a7b358a0f12e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Refreshing network info cache for port c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Start _get_guest_xml network_info=[{"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:13:35 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:35 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1517126308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1517126308',id=23,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-0foazjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:13:33Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=724f27de-2b8b-4bed-9509-a7b358a0f12e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:d7,bridge_name='br-int',has_traffic_filtering=True,id=c3a98f20-fe4a-47c5-91b4-70e0654cbd4e,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a98f20-fe') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'pci_devices' on Instance uuid 724f27de-2b8b-4bed-9509-a7b358a0f12e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:13:35 user nova-compute[74534]:   <uuid>724f27de-2b8b-4bed-9509-a7b358a0f12e</uuid>
Nov 02 12:13:35 user nova-compute[74534]:   <name>instance-00000017</name>
Nov 02 12:13:35 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:13:35 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:13:35 user nova-compute[74534]:   <metadata>
Nov 02 12:13:35 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:13:35 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:13:35 user nova-compute[74534]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1517126308</nova:name>
Nov 02 12:13:35 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:13:35</nova:creationTime>
Nov 02 12:13:35 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:13:35 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:13:35 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:13:35 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:13:35 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:13:35 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:13:35 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:13:35 user nova-compute[74534]:       <nova:owner>
Nov 02 12:13:35 user nova-compute[74534]:         <nova:user uuid="caf5cde0e75e444da00c7bcda4bcdd28">tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member</nova:user>
Nov 02 12:13:35 user nova-compute[74534]:         <nova:project uuid="25ccb20fcd184ecebd3707d9d93c8817">tempest-ServerBootFromVolumeStableRescueTest-1363504210</nova:project>
Nov 02 12:13:35 user nova-compute[74534]:       </nova:owner>
Nov 02 12:13:35 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:13:35 user nova-compute[74534]:       <nova:ports>
Nov 02 12:13:35 user nova-compute[74534]:         <nova:port uuid="c3a98f20-fe4a-47c5-91b4-70e0654cbd4e">
Nov 02 12:13:35 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 12:13:35 user nova-compute[74534]:         </nova:port>
Nov 02 12:13:35 user nova-compute[74534]:       </nova:ports>
Nov 02 12:13:35 user nova-compute[74534]:     </nova:instance>
Nov 02 12:13:35 user nova-compute[74534]:   </metadata>
Nov 02 12:13:35 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:13:35 user nova-compute[74534]:     <system>
Nov 02 12:13:35 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:13:35 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:13:35 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:13:35 user nova-compute[74534]:       <entry name="serial">724f27de-2b8b-4bed-9509-a7b358a0f12e</entry>
Nov 02 12:13:35 user nova-compute[74534]:       <entry name="uuid">724f27de-2b8b-4bed-9509-a7b358a0f12e</entry>
Nov 02 12:13:35 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:13:35 user nova-compute[74534]:     </system>
Nov 02 12:13:35 user nova-compute[74534]:   </sysinfo>
Nov 02 12:13:35 user nova-compute[74534]:   <os>
Nov 02 12:13:35 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:13:35 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:13:35 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:13:35 user nova-compute[74534]:   </os>
Nov 02 12:13:35 user nova-compute[74534]:   <features>
Nov 02 12:13:35 user nova-compute[74534]:     <acpi/>
Nov 02 12:13:35 user nova-compute[74534]:     <apic/>
Nov 02 12:13:35 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:13:35 user nova-compute[74534]:   </features>
Nov 02 12:13:35 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:13:35 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:13:35 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:13:35 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:13:35 user nova-compute[74534]:   </clock>
Nov 02 12:13:35 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:13:35 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:13:35 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:13:35 user nova-compute[74534]:   </cpu>
Nov 02 12:13:35 user nova-compute[74534]:   <devices>
Nov 02 12:13:35 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:13:35 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:13:35 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk"/>
Nov 02 12:13:35 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:13:35 user nova-compute[74534]:     </disk>
Nov 02 12:13:35 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:13:35 user nova-compute[74534]:       <mac address="fa:16:3e:bc:6a:d7"/>
Nov 02 12:13:35 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:13:35 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:13:35 user nova-compute[74534]:       <target dev="tapc3a98f20-fe"/>
Nov 02 12:13:35 user nova-compute[74534]:     </interface>
Nov 02 12:13:35 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:13:35 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/console.log" append="off"/>
Nov 02 12:13:35 user nova-compute[74534]:     </serial>
Nov 02 12:13:35 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:13:35 user nova-compute[74534]:     <video>
Nov 02 12:13:35 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:13:35 user nova-compute[74534]:     </video>
Nov 02 12:13:35 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:13:35 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:13:35 user nova-compute[74534]:     </rng>
Nov 02 12:13:35 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:13:35 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:13:35 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:13:35 user nova-compute[74534]:     </memballoon>
Nov 02 12:13:35 user nova-compute[74534]:   </devices>
Nov 02 12:13:35 user nova-compute[74534]: </domain>
Nov 02 12:13:35 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1517126308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1517126308',id=23,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-0foazjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:13:33Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=724f27de-2b8b-4bed-9509-a7b358a0f12e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:d7,bridge_name='br-int',has_traffic_filtering=True,id=c3a98f20-fe4a-47c5-91b4-70e0654cbd4e,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a98f20-fe') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG os_vif [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:d7,bridge_name='br-int',has_traffic_filtering=True,id=c3a98f20-fe4a-47c5-91b4-70e0654cbd4e,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a98f20-fe') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3156123-337e-5636-a4e9-7dec40d26c27', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a98f20-fe, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3a98f20-fe, col_values=(('qos', UUID('ebdb3b99-b08c-4008-aab9-66027f01409c')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3a98f20-fe, col_values=(('external_ids', {'iface-id': 'c3a98f20-fe4a-47c5-91b4-70e0654cbd4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:6a:d7', 'vm-uuid': '724f27de-2b8b-4bed-9509-a7b358a0f12e'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:35 user nova-compute[74534]: INFO os_vif [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:d7,bridge_name='br-int',has_traffic_filtering=True,id=c3a98f20-fe4a-47c5-91b4-70e0654cbd4e,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a98f20-fe')
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No VIF found with MAC fa:16:3e:bc:6a:d7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Updated VIF entry in instance network info cache for port c3a98f20-fe4a-47c5-91b4-70e0654cbd4e. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Updating instance_info_cache with network_info: [{"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4009eeb-4d27-46d9-846e-ff21f8e482e7 req-114584e3-9b1b-4692-99f5-2c29a0def239 service nova] Releasing lock "refresh_cache-724f27de-2b8b-4bed-9509-a7b358a0f12e" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:13:35 user nova-compute[74534]: INFO nova.compute.manager [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Rescuing
Nov 02 12:13:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:13:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68f79d06-363a-44d0-a74a-4c745558f0ea', 'attached_at': '', 'detached_at': '', 'volume_id': '0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'serial': '0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQByePkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'd9481ee1-d218-4445-ba35-69bd0997c27b'}, 'status': 'reserved', 'instance': '68f79d06-363a-44d0-a74a-4c745558f0ea', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9481ee1-d218-4445-ba35-69bd0997c27b', 'serial'} {{(pid=74534) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:36 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:36 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:36 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd19246f-2fe0-4884-96de-f9b262989fd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:13:36 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2ca0ea-cd1b-458c-be14-dd309ed3eaa3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d] added
Nov 02 12:13:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a2a43c-caad-4e23-ad20-bfbf57e6de9d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[928652f3-2b8c-4900-9ffb-a71cecf8c309]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YroTkOBc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YroTkOBc" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d69f56-444a-4fa1-93a1-61b5e873a18e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YroTkOBc'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9519720-b3d8-4bd5-ac22-bf2f9980a94a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa338e9-71c2-41e9-9437-1c656e2f6e4a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG nova.network.neutron [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c7cd09-af67-4764-90a2-28f75187c219]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]
Nov 02 12:13:36 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.
Nov 02 12:13:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c3e3a6-fbe4-45d8-9ced-dfee5668a990]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed7e606-c762-4a7e-bf0d-5226e36d33cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:36 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e15595e-943e-4b67-b3f6-eea5014f3fae]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-d4a0e6e4-0dbf-4639-ba8b-88e6f6617478 req-1d95c7c8-1a7e-4b4e-af1d-ba75ffe58342 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-unplugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d4a0e6e4-0dbf-4639-ba8b-88e6f6617478 req-1d95c7c8-1a7e-4b4e-af1d-ba75ffe58342 service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d4a0e6e4-0dbf-4639-ba8b-88e6f6617478 req-1d95c7c8-1a7e-4b4e-af1d-ba75ffe58342 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d4a0e6e4-0dbf-4639-ba8b-88e6f6617478 req-1d95c7c8-1a7e-4b4e-af1d-ba75ffe58342 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-d4a0e6e4-0dbf-4639-ba8b-88e6f6617478 req-1d95c7c8-1a7e-4b4e-af1d-ba75ffe58342 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-unplugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:36 user nova-compute[74534]: WARNING nova.compute.manager [req-d4a0e6e4-0dbf-4639-ba8b-88e6f6617478 req-1d95c7c8-1a7e-4b4e-af1d-ba75ffe58342 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received unexpected event network-vif-unplugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with vm_state active and task_state rescuing.
Nov 02 12:13:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-f654b251-1148-4192-8e1b-f66399913e8f req-33ecc8fe-6f53-4fb4-b833-f6bbf1368ea9 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received event network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f654b251-1148-4192-8e1b-f66399913e8f req-33ecc8fe-6f53-4fb4-b833-f6bbf1368ea9 service nova] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f654b251-1148-4192-8e1b-f66399913e8f req-33ecc8fe-6f53-4fb4-b833-f6bbf1368ea9 service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f654b251-1148-4192-8e1b-f66399913e8f req-33ecc8fe-6f53-4fb4-b833-f6bbf1368ea9 service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-f654b251-1148-4192-8e1b-f66399913e8f req-33ecc8fe-6f53-4fb4-b833-f6bbf1368ea9 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] No waiting events found dispatching network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:37 user nova-compute[74534]: WARNING nova.compute.manager [req-f654b251-1148-4192-8e1b-f66399913e8f req-33ecc8fe-6f53-4fb4-b833-f6bbf1368ea9 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received unexpected event network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e for instance with vm_state building and task_state spawning.
Nov 02 12:13:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26539386236363962', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539386236363962', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lazy-loading 'flavor' on Instance uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance destroyed successfully.
Nov 02 12:13:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Attempting rescue
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74534) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance directory exists: not creating {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 12:13:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Creating image(s)
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue" returned: 0 in 0.067s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'migration_context' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.base [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<57ce1c49-200f-4b56-a1b7-78aeec6fc3ac> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Start _get_guest_xml network_info=[{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:75:4f:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36642543-2106-4841-8acf-2e35b58c4209', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'resources' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.base [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<57ce1c49-200f-4b56-a1b7-78aeec6fc3ac> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'numa_topology' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquired lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'info_cache' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.objects.base [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<57ce1c49-200f-4b56-a1b7-78aeec6fc3ac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:37 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:37 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:13:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<57ce1c49-200f-4b56-a1b7-78aeec6fc3ac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1669898121',display_name='tempest-ServerRescueNegativeTestJSON-server-1669898121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1669898121',id=21,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:11:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-kbh3bbls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:55Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=57ce1c49-200f-4b56-a1b7-78aeec6fc3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:75:4f:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:75:4f:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'pci_devices' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<57ce1c49-200f-4b56-a1b7-78aeec6fc3ac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:13:38 user nova-compute[74534]:   <uuid>57ce1c49-200f-4b56-a1b7-78aeec6fc3ac</uuid>
Nov 02 12:13:38 user nova-compute[74534]:   <name>instance-00000015</name>
Nov 02 12:13:38 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:13:38 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:13:38 user nova-compute[74534]:   <metadata>
Nov 02 12:13:38 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:13:38 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:13:38 user nova-compute[74534]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1669898121</nova:name>
Nov 02 12:13:38 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:13:37</nova:creationTime>
Nov 02 12:13:38 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:13:38 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:13:38 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:13:38 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:13:38 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:13:38 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:13:38 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:13:38 user nova-compute[74534]:       <nova:owner>
Nov 02 12:13:38 user nova-compute[74534]:         <nova:user uuid="c0dabe5e283645a382a1f0bf6ab7ddf1">tempest-ServerRescueNegativeTestJSON-158551613-project-member</nova:user>
Nov 02 12:13:38 user nova-compute[74534]:         <nova:project uuid="294df1c916c248d496812d8b2bb1b57e">tempest-ServerRescueNegativeTestJSON-158551613</nova:project>
Nov 02 12:13:38 user nova-compute[74534]:       </nova:owner>
Nov 02 12:13:38 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:13:38 user nova-compute[74534]:       <nova:ports>
Nov 02 12:13:38 user nova-compute[74534]:         <nova:port uuid="d9bef23e-680a-470e-b4dd-8162d69fa4df">
Nov 02 12:13:38 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 12:13:38 user nova-compute[74534]:         </nova:port>
Nov 02 12:13:38 user nova-compute[74534]:       </nova:ports>
Nov 02 12:13:38 user nova-compute[74534]:     </nova:instance>
Nov 02 12:13:38 user nova-compute[74534]:   </metadata>
Nov 02 12:13:38 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:13:38 user nova-compute[74534]:     <system>
Nov 02 12:13:38 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:13:38 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:13:38 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:13:38 user nova-compute[74534]:       <entry name="serial">57ce1c49-200f-4b56-a1b7-78aeec6fc3ac</entry>
Nov 02 12:13:38 user nova-compute[74534]:       <entry name="uuid">57ce1c49-200f-4b56-a1b7-78aeec6fc3ac</entry>
Nov 02 12:13:38 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:13:38 user nova-compute[74534]:     </system>
Nov 02 12:13:38 user nova-compute[74534]:   </sysinfo>
Nov 02 12:13:38 user nova-compute[74534]:   <os>
Nov 02 12:13:38 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:13:38 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:13:38 user nova-compute[74534]:   </os>
Nov 02 12:13:38 user nova-compute[74534]:   <features>
Nov 02 12:13:38 user nova-compute[74534]:     <acpi/>
Nov 02 12:13:38 user nova-compute[74534]:     <apic/>
Nov 02 12:13:38 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:13:38 user nova-compute[74534]:   </features>
Nov 02 12:13:38 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:13:38 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:13:38 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:13:38 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:13:38 user nova-compute[74534]:   </clock>
Nov 02 12:13:38 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:13:38 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:13:38 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:13:38 user nova-compute[74534]:   </cpu>
Nov 02 12:13:38 user nova-compute[74534]:   <devices>
Nov 02 12:13:38 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:13:38 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:13:38 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue"/>
Nov 02 12:13:38 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:13:38 user nova-compute[74534]:     </disk>
Nov 02 12:13:38 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:13:38 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:13:38 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk"/>
Nov 02 12:13:38 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:13:38 user nova-compute[74534]:     </disk>
Nov 02 12:13:38 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:13:38 user nova-compute[74534]:       <mac address="fa:16:3e:75:4f:99"/>
Nov 02 12:13:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:13:38 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:13:38 user nova-compute[74534]:       <target dev="tapd9bef23e-68"/>
Nov 02 12:13:38 user nova-compute[74534]:     </interface>
Nov 02 12:13:38 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:13:38 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/console.log" append="off"/>
Nov 02 12:13:38 user nova-compute[74534]:     </serial>
Nov 02 12:13:38 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:13:38 user nova-compute[74534]:     <video>
Nov 02 12:13:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:13:38 user nova-compute[74534]:     </video>
Nov 02 12:13:38 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:13:38 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:13:38 user nova-compute[74534]:     </rng>
Nov 02 12:13:38 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:13:38 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:13:38 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:13:38 user nova-compute[74534]:     </memballoon>
Nov 02 12:13:38 user nova-compute[74534]:   </devices>
Nov 02 12:13:38 user nova-compute[74534]: </domain>
Nov 02 12:13:38 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:13:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance destroyed successfully.
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No VIF found with MAC fa:16:3e:75:4f:99, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-bec165ff-db05-41ba-9150-cbcc801c4b5c req-47634668-d82c-4719-9b07-ebfdd5918f19 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event volume-reimaged-23064b31-3e27-4c42-85d0-0cc2fe4ba016 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bec165ff-db05-41ba-9150-cbcc801c4b5c req-47634668-d82c-4719-9b07-ebfdd5918f19 service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bec165ff-db05-41ba-9150-cbcc801c4b5c req-47634668-d82c-4719-9b07-ebfdd5918f19 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bec165ff-db05-41ba-9150-cbcc801c4b5c req-47634668-d82c-4719-9b07-ebfdd5918f19 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-bec165ff-db05-41ba-9150-cbcc801c4b5c req-47634668-d82c-4719-9b07-ebfdd5918f19 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Processing event volume-reimaged-23064b31-3e27-4c42-85d0-0cc2fe4ba016 {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance event wait completed in 35 seconds for volume-reimaged {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:13:38 user nova-compute[74534]: INFO nova.virt.block_device [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Booting with volume 23064b31-3e27-4c42-85d0-0cc2fe4ba016 at /dev/vda
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 111149056 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG os_brick.utils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0588ac0-6f5d-45fe-bd56-eb93759b0960]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba97d90-fde5-4fcf-9710-0c67f7c41ba7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9818d-4f6e-4125-a614-a19e967810c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d032c74-1cf7-410d-b432-ae05364de67b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:13:38 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[03af47aa-4285-4951-97ca-a335e764001d]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG os_brick.utils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updating existing volume attachment record: 496a641e-d9a1-40b2-8202-bc4d6c1a4991 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Releasing lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-50fe8ef6-daed-49aa-b9b7-82f872592a86 req-d4d0b390-114b-4933-a31d-c561d562b574 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50fe8ef6-daed-49aa-b9b7-82f872592a86 req-d4d0b390-114b-4933-a31d-c561d562b574 service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50fe8ef6-daed-49aa-b9b7-82f872592a86 req-d4d0b390-114b-4933-a31d-c561d562b574 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-50fe8ef6-daed-49aa-b9b7-82f872592a86 req-d4d0b390-114b-4933-a31d-c561d562b574 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-50fe8ef6-daed-49aa-b9b7-82f872592a86 req-d4d0b390-114b-4933-a31d-c561d562b574 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:38 user nova-compute[74534]: WARNING nova.compute.manager [req-50fe8ef6-daed-49aa-b9b7-82f872592a86 req-d4d0b390-114b-4933-a31d-c561d562b574 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received unexpected event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with vm_state active and task_state rescuing.
Nov 02 12:13:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance destroyed successfully.
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'resources' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG os_vif [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f86a40-46, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e662c74a-cf66-48d7-9a64-e9f2f3a5ce3c) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:39 user nova-compute[74534]: INFO os_vif [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46')
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Start _get_guest_xml network_info=[{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'numa_topology' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.base [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:39 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:39 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 245366784 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.base [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'pci_devices' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.base [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:13:39 user nova-compute[74534]:   <uuid>ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</uuid>
Nov 02 12:13:39 user nova-compute[74534]:   <name>instance-00000004</name>
Nov 02 12:13:39 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:13:39 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:13:39 user nova-compute[74534]:   <metadata>
Nov 02 12:13:39 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:13:39 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:13:39 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeTestJSON-server-884397019</nova:name>
Nov 02 12:13:39 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:13:39</nova:creationTime>
Nov 02 12:13:39 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:13:39 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:13:39 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:13:39 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:13:39 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:13:39 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:13:39 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:13:39 user nova-compute[74534]:       <nova:owner>
Nov 02 12:13:39 user nova-compute[74534]:         <nova:user uuid="4eb3d0118fba4c4eb8edebcb7e68eb93">tempest-AttachVolumeTestJSON-1871374392-project-member</nova:user>
Nov 02 12:13:39 user nova-compute[74534]:         <nova:project uuid="6f40e1ed522748be85c5bdd3b6405652">tempest-AttachVolumeTestJSON-1871374392</nova:project>
Nov 02 12:13:39 user nova-compute[74534]:       </nova:owner>
Nov 02 12:13:39 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:13:39 user nova-compute[74534]:       <nova:ports>
Nov 02 12:13:39 user nova-compute[74534]:         <nova:port uuid="77f86a40-464c-4f30-a11d-abf8b4a7f8d4">
Nov 02 12:13:39 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:13:39 user nova-compute[74534]:         </nova:port>
Nov 02 12:13:39 user nova-compute[74534]:       </nova:ports>
Nov 02 12:13:39 user nova-compute[74534]:     </nova:instance>
Nov 02 12:13:39 user nova-compute[74534]:   </metadata>
Nov 02 12:13:39 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:13:39 user nova-compute[74534]:     <system>
Nov 02 12:13:39 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:13:39 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:13:39 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:13:39 user nova-compute[74534]:       <entry name="serial">ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</entry>
Nov 02 12:13:39 user nova-compute[74534]:       <entry name="uuid">ed72d4f3-1405-4e45-8c51-68b6fa57a3c1</entry>
Nov 02 12:13:39 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:13:39 user nova-compute[74534]:     </system>
Nov 02 12:13:39 user nova-compute[74534]:   </sysinfo>
Nov 02 12:13:39 user nova-compute[74534]:   <os>
Nov 02 12:13:39 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:13:39 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:13:39 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:13:39 user nova-compute[74534]:   </os>
Nov 02 12:13:39 user nova-compute[74534]:   <features>
Nov 02 12:13:39 user nova-compute[74534]:     <acpi/>
Nov 02 12:13:39 user nova-compute[74534]:     <apic/>
Nov 02 12:13:39 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:13:39 user nova-compute[74534]:   </features>
Nov 02 12:13:39 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:13:39 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:13:39 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:13:39 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:13:39 user nova-compute[74534]:   </clock>
Nov 02 12:13:39 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:13:39 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:13:39 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:13:39 user nova-compute[74534]:   </cpu>
Nov 02 12:13:39 user nova-compute[74534]:   <devices>
Nov 02 12:13:39 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:13:39 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:13:39 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk"/>
Nov 02 12:13:39 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:13:39 user nova-compute[74534]:     </disk>
Nov 02 12:13:39 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:13:39 user nova-compute[74534]:       <mac address="fa:16:3e:72:88:5c"/>
Nov 02 12:13:39 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:13:39 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:13:39 user nova-compute[74534]:       <target dev="tap77f86a40-46"/>
Nov 02 12:13:39 user nova-compute[74534]:     </interface>
Nov 02 12:13:39 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:13:39 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/console.log" append="off"/>
Nov 02 12:13:39 user nova-compute[74534]:     </serial>
Nov 02 12:13:39 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:13:39 user nova-compute[74534]:     <video>
Nov 02 12:13:39 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:13:39 user nova-compute[74534]:     </video>
Nov 02 12:13:39 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:13:39 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:13:39 user nova-compute[74534]:     </rng>
Nov 02 12:13:39 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:13:39 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:13:39 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:13:39 user nova-compute[74534]:     </memballoon>
Nov 02 12:13:39 user nova-compute[74534]:   </devices>
Nov 02 12:13:39 user nova-compute[74534]: </domain>
Nov 02 12:13:39 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-858798ae-d1d0-4b07-baa5-aa3de52c55ce req-00f290f1-28cc-41b9-94f7-ccf95122bc70 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received event network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-858798ae-d1d0-4b07-baa5-aa3de52c55ce req-00f290f1-28cc-41b9-94f7-ccf95122bc70 service nova] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-858798ae-d1d0-4b07-baa5-aa3de52c55ce req-00f290f1-28cc-41b9-94f7-ccf95122bc70 service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-858798ae-d1d0-4b07-baa5-aa3de52c55ce req-00f290f1-28cc-41b9-94f7-ccf95122bc70 service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-858798ae-d1d0-4b07-baa5-aa3de52c55ce req-00f290f1-28cc-41b9-94f7-ccf95122bc70 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] No waiting events found dispatching network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:39 user nova-compute[74534]: WARNING nova.compute.manager [req-858798ae-d1d0-4b07-baa5-aa3de52c55ce req-00f290f1-28cc-41b9-94f7-ccf95122bc70 service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received unexpected event network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e for instance with vm_state building and task_state spawning.
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 400556032 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.objects.base [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.216s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:13:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 541065216 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Cannot resize image /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'migration_context' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.objects.base [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Object Instance<ed72d4f3-1405-4e45-8c51-68b6fa57a3c1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG os_vif [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c6cbe1e-6215-585b-a8b9-cffff15f9e89', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77f86a40-46, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77f86a40-46, col_values=(('qos', UUID('c0ef4f79-6b81-495c-88ea-e85b8eaeb4ee')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77f86a40-46, col_values=(('external_ids', {'iface-id': '77f86a40-464c-4f30-a11d-abf8b4a7f8d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:88:5c', 'vm-uuid': 'ed72d4f3-1405-4e45-8c51-68b6fa57a3c1'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: INFO os_vif [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46')
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 689963008 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:13:40 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Instance spawned successfully.
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:13:40 user nova-compute[74534]: INFO nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Took 7.36 seconds to spawn the instance on the hypervisor.
Nov 02 12:13:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:41 user nova-compute[74534]: WARNING nova.compute.manager [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received unexpected event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with vm_state active and task_state rescuing.
Nov 02 12:13:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:41 user nova-compute[74534]: WARNING nova.compute.manager [req-6968b482-7735-4489-a058-bd0b198dfd47 req-d521ba93-6fb3-4387-a50a-7b1ca00ff308 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received unexpected event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with vm_state active and task_state rescuing.
Nov 02 12:13:41 user nova-compute[74534]: INFO nova.compute.manager [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Took 8.35 seconds to build instance.
Nov 02 12:13:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7bd1830-e822-4158-8857-5da49ada5529 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.478s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 817889280 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 913309696 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 1062207488 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQByePkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'd9481ee1-d218-4445-ba35-69bd0997c27b'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:13:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe5b169-58c6-4b71-bb0f-b91a3c3d4bba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:13:42 user nova-compute[74534]: No targets found.
Nov 02 12:13:42 user nova-compute[74534]: iSNS:
Nov 02 12:13:42 user nova-compute[74534]: No targets found.
Nov 02 12:13:42 user nova-compute[74534]: STATIC:
Nov 02 12:13:42 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:13:42 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:42 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:42 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b
Nov 02 12:13:42 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:42 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:42 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:13:42 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:42 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:42 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:13:42 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:13:42 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:13:42 user nova-compute[74534]: FIRMWARE:
Nov 02 12:13:42 user nova-compute[74534]: No targets found.
Nov 02 12:13:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:13:42 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:13:42 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8bc84-7c99-4cb8-bafa-65ba229186a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cd8a88-0702-4fb9-a95f-7cdfbfb9d81a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:42 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:42 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:42 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:13:42 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:13:42 user nova-compute[74534]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b (non-flash)
Nov 02 12:13:42 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:13:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180494160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b'): ({'sdf'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Removing single pathed devices sdf {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[78777c9d-47d0-4ef9-83b4-01b9c5ab4612]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e5e7d-441e-45a5-8e5f-bfc69fca62e5]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Flushing IO for device /dev/sdf {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:13:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1347f5-9c0a-4eaa-b47d-cc51d3e81351]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:43 user nova-compute[74534]: WARNING nova.compute.manager [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state stopped and task_state powering-on.
Nov 02 12:13:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:13:43 user nova-compute[74534]: WARNING nova.compute.manager [req-6cdada14-b7d7-4581-b699-38d1767a686c req-40bad9ea-5d04-431f-805b-827d69556a8e service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state stopped and task_state powering-on.
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab08f0-c721-446b-b7d3-d0977ad2c9cc]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebfcfc2-b64a-4040-80fb-814be016410e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d01f4b-49ed-4be3-88dd-1d6332c375d0]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260]
Nov 02 12:13:43 user nova-compute[74534]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b, portal: 172.16.0.220,3260] successful.
Nov 02 12:13:43 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9481ee1-d218-4445-ba35-69bd0997c27b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[915c8bc5-3470-4220-863b-f75c047be868]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] <== disconnect_volume: return (386ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '68f79d06-363a-44d0-a74a-4c745558f0ea', 'attached_at': '', 'detached_at': '', 'volume_id': '0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'serial'} {{(pid=74534) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] swap_volume: removing Cinder connection for volume d9481ee1-d218-4445-ba35-69bd0997c27b {{(pid=74534) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-095013c2-5bf7-442e-b9cd-145eeab028f9 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:13:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:13:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance rebooted successfully.
Nov 02 12:13:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2420fde1-599e-40df-8233-6a936dbf7bda tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:13:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "d5330cc9-9437-4276-95f9-7b2909d0e49a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:13:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:57 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:13:57 user nova-compute[74534]: INFO nova.compute.claims [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Claim successful on node user
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:13:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.policy [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a71588ab6ed4d93aa359a76cbc9f7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb39968885c2474e97da3a7e426c0e17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:13:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Creating image(s)
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "/opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "/opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.198s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk 1073741824" returned: 0 in 0.075s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Cannot resize image /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Ensure instance console log exists: /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:13:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Successfully created port: 1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [{"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Successfully updated port: 1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "refresh_cache-d5330cc9-9437-4276-95f9-7b2909d0e49a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquired lock "refresh_cache-d5330cc9-9437-4276-95f9-7b2909d0e49a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received event network-changed-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Refreshing instance network info cache due to event network-changed-1dd20b02-2dd1-4399-859c-4aa0415c268f. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] Acquiring lock "refresh_cache-d5330cc9-9437-4276-95f9-7b2909d0e49a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:14:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Updating instance_info_cache with network_info: [{"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Releasing lock "refresh_cache-d5330cc9-9437-4276-95f9-7b2909d0e49a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Instance network_info: |[{"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] Acquired lock "refresh_cache-d5330cc9-9437-4276-95f9-7b2909d0e49a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Refreshing network info cache for port 1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Start _get_guest_xml network_info=[{"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:14:01 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:14:01 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-774729383',display_name='tempest-VolumesAdminNegativeTest-server-774729383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-774729383',id=24,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb39968885c2474e97da3a7e426c0e17',ramdisk_id='',reservation_id='r-erssyos8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1124753556',owner_user_name='tempest-VolumesAdminNegativeTest-1124753556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:13:59Z,user_data=None,user_id='2a71588ab6ed4d93aa359a76cbc9f7ac',uuid=d5330cc9-9437-4276-95f9-7b2909d0e49a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converting VIF {"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:32:a5,bridge_name='br-int',has_traffic_filtering=True,id=1dd20b02-2dd1-4399-859c-4aa0415c268f,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd20b02-2d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lazy-loading 'pci_devices' on Instance uuid d5330cc9-9437-4276-95f9-7b2909d0e49a {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:14:01 user nova-compute[74534]:   <uuid>d5330cc9-9437-4276-95f9-7b2909d0e49a</uuid>
Nov 02 12:14:01 user nova-compute[74534]:   <name>instance-00000018</name>
Nov 02 12:14:01 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:14:01 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:14:01 user nova-compute[74534]:   <metadata>
Nov 02 12:14:01 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:14:01 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:14:01 user nova-compute[74534]:       <nova:name>tempest-VolumesAdminNegativeTest-server-774729383</nova:name>
Nov 02 12:14:01 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:14:01</nova:creationTime>
Nov 02 12:14:01 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:14:01 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:14:01 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:14:01 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:14:01 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:14:01 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:14:01 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:14:01 user nova-compute[74534]:       <nova:owner>
Nov 02 12:14:01 user nova-compute[74534]:         <nova:user uuid="2a71588ab6ed4d93aa359a76cbc9f7ac">tempest-VolumesAdminNegativeTest-1124753556-project-member</nova:user>
Nov 02 12:14:01 user nova-compute[74534]:         <nova:project uuid="bb39968885c2474e97da3a7e426c0e17">tempest-VolumesAdminNegativeTest-1124753556</nova:project>
Nov 02 12:14:01 user nova-compute[74534]:       </nova:owner>
Nov 02 12:14:01 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:14:01 user nova-compute[74534]:       <nova:ports>
Nov 02 12:14:01 user nova-compute[74534]:         <nova:port uuid="1dd20b02-2dd1-4399-859c-4aa0415c268f">
Nov 02 12:14:01 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:14:01 user nova-compute[74534]:         </nova:port>
Nov 02 12:14:01 user nova-compute[74534]:       </nova:ports>
Nov 02 12:14:01 user nova-compute[74534]:     </nova:instance>
Nov 02 12:14:01 user nova-compute[74534]:   </metadata>
Nov 02 12:14:01 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:14:01 user nova-compute[74534]:     <system>
Nov 02 12:14:01 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:14:01 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:14:01 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:14:01 user nova-compute[74534]:       <entry name="serial">d5330cc9-9437-4276-95f9-7b2909d0e49a</entry>
Nov 02 12:14:01 user nova-compute[74534]:       <entry name="uuid">d5330cc9-9437-4276-95f9-7b2909d0e49a</entry>
Nov 02 12:14:01 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:14:01 user nova-compute[74534]:     </system>
Nov 02 12:14:01 user nova-compute[74534]:   </sysinfo>
Nov 02 12:14:01 user nova-compute[74534]:   <os>
Nov 02 12:14:01 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:14:01 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:14:01 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:14:01 user nova-compute[74534]:   </os>
Nov 02 12:14:01 user nova-compute[74534]:   <features>
Nov 02 12:14:01 user nova-compute[74534]:     <acpi/>
Nov 02 12:14:01 user nova-compute[74534]:     <apic/>
Nov 02 12:14:01 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:14:01 user nova-compute[74534]:   </features>
Nov 02 12:14:01 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:14:01 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:14:01 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:14:01 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:14:01 user nova-compute[74534]:   </clock>
Nov 02 12:14:01 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:14:01 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:14:01 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:14:01 user nova-compute[74534]:   </cpu>
Nov 02 12:14:01 user nova-compute[74534]:   <devices>
Nov 02 12:14:01 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:14:01 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:14:01 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk"/>
Nov 02 12:14:01 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:14:01 user nova-compute[74534]:     </disk>
Nov 02 12:14:01 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:14:01 user nova-compute[74534]:       <mac address="fa:16:3e:67:32:a5"/>
Nov 02 12:14:01 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:14:01 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:14:01 user nova-compute[74534]:       <target dev="tap1dd20b02-2d"/>
Nov 02 12:14:01 user nova-compute[74534]:     </interface>
Nov 02 12:14:01 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:14:01 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/console.log" append="off"/>
Nov 02 12:14:01 user nova-compute[74534]:     </serial>
Nov 02 12:14:01 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:14:01 user nova-compute[74534]:     <video>
Nov 02 12:14:01 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:14:01 user nova-compute[74534]:     </video>
Nov 02 12:14:01 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:14:01 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:14:01 user nova-compute[74534]:     </rng>
Nov 02 12:14:01 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:14:01 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:14:01 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:14:01 user nova-compute[74534]:     </memballoon>
Nov 02 12:14:01 user nova-compute[74534]:   </devices>
Nov 02 12:14:01 user nova-compute[74534]: </domain>
Nov 02 12:14:01 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-774729383',display_name='tempest-VolumesAdminNegativeTest-server-774729383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-774729383',id=24,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb39968885c2474e97da3a7e426c0e17',ramdisk_id='',reservation_id='r-erssyos8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1124753556',owner_user_name='tempest-VolumesAdminNegativeTest-1124753556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:13:59Z,user_data=None,user_id='2a71588ab6ed4d93aa359a76cbc9f7ac',uuid=d5330cc9-9437-4276-95f9-7b2909d0e49a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converting VIF {"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:32:a5,bridge_name='br-int',has_traffic_filtering=True,id=1dd20b02-2dd1-4399-859c-4aa0415c268f,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd20b02-2d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG os_vif [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:32:a5,bridge_name='br-int',has_traffic_filtering=True,id=1dd20b02-2dd1-4399-859c-4aa0415c268f,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd20b02-2d') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1cac74e-8846-526f-aee8-f8042d419fb6', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dd20b02-2d, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dd20b02-2d, col_values=(('qos', UUID('2fba8672-2a1a-422f-8e09-e420a49895fd')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dd20b02-2d, col_values=(('external_ids', {'iface-id': '1dd20b02-2dd1-4399-859c-4aa0415c268f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:32:a5', 'vm-uuid': 'd5330cc9-9437-4276-95f9-7b2909d0e49a'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:01 user nova-compute[74534]: INFO os_vif [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:32:a5,bridge_name='br-int',has_traffic_filtering=True,id=1dd20b02-2dd1-4399-859c-4aa0415c268f,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd20b02-2d')
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] No VIF found with MAC fa:16:3e:67:32:a5, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Updated VIF entry in instance network info cache for port 1dd20b02-2dd1-4399-859c-4aa0415c268f. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Updating instance_info_cache with network_info: [{"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-feadd4f0-a58b-4e21-99bf-63cf4db68721 req-d4468088-05b9-4894-8af4-4849734c1128 service nova] Releasing lock "refresh_cache-d5330cc9-9437-4276-95f9-7b2909d0e49a" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:02 user nova-compute[74534]: INFO nova.compute.manager [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Detaching volume 63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:14:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:02 user nova-compute[74534]: INFO nova.virt.block_device [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Attempting to driver detach volume 63b6a609-c704-4b97-99c0-03babdd70321 from mountpoint /dev/vdb
Nov 02 12:14:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Attempting to detach device vdb from instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:14:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:14:02 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:02 user nova-compute[74534]:   <source dev="/dev/sde"/>
Nov 02 12:14:02 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:14:02 user nova-compute[74534]:   <serial>63b6a609-c704-4b97-99c0-03babdd70321</serial>
Nov 02 12:14:02 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:14:02 user nova-compute[74534]: </disk>
Nov 02 12:14:02 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:14:03 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully detached device vdb from instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e from the persistent domain config.
Nov 02 12:14:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:14:03 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:03 user nova-compute[74534]:   <source dev="/dev/sde"/>
Nov 02 12:14:03 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:14:03 user nova-compute[74534]:   <serial>63b6a609-c704-4b97-99c0-03babdd70321</serial>
Nov 02 12:14:03 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:14:03 user nova-compute[74534]: </disk>
Nov 02 12:14:03 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-49090f43-ab3c-44d9-ab51-19621657b7f2 req-8ce7c002-2b40-4637-b57a-8b0a092c51bf service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received event network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-49090f43-ab3c-44d9-ab51-19621657b7f2 req-8ce7c002-2b40-4637-b57a-8b0a092c51bf service nova] Acquiring lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-49090f43-ab3c-44d9-ab51-19621657b7f2 req-8ce7c002-2b40-4637-b57a-8b0a092c51bf service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-49090f43-ab3c-44d9-ab51-19621657b7f2 req-8ce7c002-2b40-4637-b57a-8b0a092c51bf service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-49090f43-ab3c-44d9-ab51-19621657b7f2 req-8ce7c002-2b40-4637-b57a-8b0a092c51bf service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] No waiting events found dispatching network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:03 user nova-compute[74534]: WARNING nova.compute.manager [req-49090f43-ab3c-44d9-ab51-19621657b7f2 req-8ce7c002-2b40-4637-b57a-8b0a092c51bf service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received unexpected event network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f for instance with vm_state building and task_state spawning.
Nov 02 12:14:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:14:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-89c04596-8978-4747-a4da-cd149d341950 req-4606926b-7b9b-4cc9-a780-5f95571f9ed2 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received event network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-89c04596-8978-4747-a4da-cd149d341950 req-4606926b-7b9b-4cc9-a780-5f95571f9ed2 service nova] Acquiring lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-89c04596-8978-4747-a4da-cd149d341950 req-4606926b-7b9b-4cc9-a780-5f95571f9ed2 service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-89c04596-8978-4747-a4da-cd149d341950 req-4606926b-7b9b-4cc9-a780-5f95571f9ed2 service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-89c04596-8978-4747-a4da-cd149d341950 req-4606926b-7b9b-4cc9-a780-5f95571f9ed2 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] No waiting events found dispatching network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:05 user nova-compute[74534]: WARNING nova.compute.manager [req-89c04596-8978-4747-a4da-cd149d341950 req-4606926b-7b9b-4cc9-a780-5f95571f9ed2 service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received unexpected event network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f for instance with vm_state building and task_state spawning.
Nov 02 12:14:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] swap_volume: Updating volume d9481ee1-d218-4445-ba35-69bd0997c27b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "YroTkOBc", "auth_password": "ltF9cQzMWAZY2q", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d"}, "status": "reserved", "instance": "68f79d06-363a-44d0-a74a-4c745558f0ea", "attached_at": "", "detached_at": "", "volume_id": "0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d", "serial": "0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'no_device': None, 'attachment_id': '1842bbdc-c105-42aa-9ac7-a218265f2f16'} {{(pid=74534) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9be9fbe7-653a-42ee-974d-faf586ce0392 tempest-TestVolumeSwap-660457769 tempest-TestVolumeSwap-660457769-project-admin] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 53.124s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:14:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Instance spawned successfully.
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: INFO nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Took 7.54 seconds to spawn the instance on the hypervisor.
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:14:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Creating image(s)
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Ensure instance console log exists: /opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Start _get_guest_xml network_info=[{"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': '496a641e-d9a1-40b2-8202-bc4d6c1a4991', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9159e85-6d12-4166-be94-8f8b1620761a', 'attached_at': '', 'detached_at': '', 'volume_id': '23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'serial': '23064b31-3e27-4c42-85d0-0cc2fe4ba016'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:14:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 12:14:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: INFO nova.compute.manager [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Took 8.74 seconds to build instance.
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3e352e49-64e4-4655-a3a6-d4d71cd9cbb8 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.881s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9159e85-6d12-4166-be94-8f8b1620761a {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:14:06 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:14:06 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:14:06 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d2ff99-af8a-450c-b5e2-b58274c4d6d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:14:06 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9ef23f-3246-4592-b07c-6f0dffa445dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016] added
Nov 02 12:14:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed752116-58c7-47c9-9106-55e1f524147f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bed3321-bf0a-4f35-aa4f-eae8dd042255]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUWjdena {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUWjdena" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3cee0a-6a6a-4435-b6b3-7033067cf235]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUWjdena'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfd4770-d12c-47f8-9043-4b6cf1ff8691]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5181ed12-cbe5-4480-8c32-ec80d2d875f2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:06 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:14:06 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:06 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:14:06 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c6a36-ff0f-48c5-bee6-0d4684372abd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]
Nov 02 12:14:06 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.
Nov 02 12:14:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[532f048e-fe86-4a86-af73-1f36e768ae5a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d80c4d2-614a-4fcb-9a0c-248f170a5bbd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:07 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:14:07 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:07 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:07 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:14:07 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:07 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.530s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc316e5-1a8e-4b2c-81d6-33eaaff04cef]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:14:07 user nova-compute[74534]: INFO nova.compute.claims [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Claim successful on node user
Nov 02 12:14:07 user nova-compute[74534]: INFO nova.compute.manager [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Detaching volume 0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:07 user nova-compute[74534]: INFO nova.virt.block_device [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Attempting to driver detach volume 0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d from mountpoint /dev/vdb
Nov 02 12:14:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Attempting to detach device vdb from instance 68f79d06-363a-44d0-a74a-4c745558f0ea from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:14:07 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:07 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:14:07 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:14:07 user nova-compute[74534]:   <serial>0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d</serial>
Nov 02 12:14:07 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:14:07 user nova-compute[74534]: </disk>
Nov 02 12:14:07 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:14:07 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Successfully detached device vdb from instance 68f79d06-363a-44d0-a74a-4c745558f0ea from the persistent domain config.
Nov 02 12:14:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68f79d06-363a-44d0-a74a-4c745558f0ea from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:14:07 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:07 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:14:07 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:14:07 user nova-compute[74534]:   <serial>0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d</serial>
Nov 02 12:14:07 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:14:07 user nova-compute[74534]: </disk>
Nov 02 12:14:07 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.592s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] <== connect_volume: return (1595ms) {'type': 'block', 'scsi_wwn': '23531373934333563', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531373934333563', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1445971962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718226071',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUvT97WEExqR0OQmGwpmELMt+ImPLb1+mXmovwHR4XLPFB0ez6vAOasZmSPO2WheLOO9pmkHuFYo38fre1rCWoG3U01qW0dS1//or12B5d7TtxG9aJO7yiW6xIGkwXZog==',key_name='tempest-keypair-1558372433',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d863bade99ab4f4e946637975a0f7224',ramdisk_id='',reservation_id='r-pec8wqms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1315298848',owner_user_name='tempest-ServerActionsV293TestJSON-1315298848-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3db2c5117c754142978c7a872de22fb4',uuid=a9159e85-6d12-4166-be94-8f8b1620761a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converting VIF {"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:14:08 user nova-compute[74534]:   <uuid>a9159e85-6d12-4166-be94-8f8b1620761a</uuid>
Nov 02 12:14:08 user nova-compute[74534]:   <name>instance-00000013</name>
Nov 02 12:14:08 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:14:08 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:14:08 user nova-compute[74534]:   <metadata>
Nov 02 12:14:08 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:14:08 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:14:08 user nova-compute[74534]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1445971962</nova:name>
Nov 02 12:14:08 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:14:06</nova:creationTime>
Nov 02 12:14:08 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:14:08 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:14:08 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:14:08 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:14:08 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:14:08 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:14:08 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:14:08 user nova-compute[74534]:       <nova:owner>
Nov 02 12:14:08 user nova-compute[74534]:         <nova:user uuid="3db2c5117c754142978c7a872de22fb4">tempest-ServerActionsV293TestJSON-1315298848-project-member</nova:user>
Nov 02 12:14:08 user nova-compute[74534]:         <nova:project uuid="d863bade99ab4f4e946637975a0f7224">tempest-ServerActionsV293TestJSON-1315298848</nova:project>
Nov 02 12:14:08 user nova-compute[74534]:       </nova:owner>
Nov 02 12:14:08 user nova-compute[74534]:       <nova:ports>
Nov 02 12:14:08 user nova-compute[74534]:         <nova:port uuid="3704c8b5-ecf1-441a-8c0e-9219f2e12835">
Nov 02 12:14:08 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 12:14:08 user nova-compute[74534]:         </nova:port>
Nov 02 12:14:08 user nova-compute[74534]:       </nova:ports>
Nov 02 12:14:08 user nova-compute[74534]:     </nova:instance>
Nov 02 12:14:08 user nova-compute[74534]:   </metadata>
Nov 02 12:14:08 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:14:08 user nova-compute[74534]:     <system>
Nov 02 12:14:08 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:14:08 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:14:08 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:14:08 user nova-compute[74534]:       <entry name="serial">a9159e85-6d12-4166-be94-8f8b1620761a</entry>
Nov 02 12:14:08 user nova-compute[74534]:       <entry name="uuid">a9159e85-6d12-4166-be94-8f8b1620761a</entry>
Nov 02 12:14:08 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:14:08 user nova-compute[74534]:     </system>
Nov 02 12:14:08 user nova-compute[74534]:   </sysinfo>
Nov 02 12:14:08 user nova-compute[74534]:   <os>
Nov 02 12:14:08 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:14:08 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:14:08 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:14:08 user nova-compute[74534]:   </os>
Nov 02 12:14:08 user nova-compute[74534]:   <features>
Nov 02 12:14:08 user nova-compute[74534]:     <acpi/>
Nov 02 12:14:08 user nova-compute[74534]:     <apic/>
Nov 02 12:14:08 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:14:08 user nova-compute[74534]:   </features>
Nov 02 12:14:08 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:14:08 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:14:08 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:14:08 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:14:08 user nova-compute[74534]:   </clock>
Nov 02 12:14:08 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:14:08 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:14:08 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:14:08 user nova-compute[74534]:   </cpu>
Nov 02 12:14:08 user nova-compute[74534]:   <devices>
Nov 02 12:14:08 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:14:08 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:08 user nova-compute[74534]:       <source dev="/dev/sdc"/>
Nov 02 12:14:08 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:14:08 user nova-compute[74534]:       <serial>23064b31-3e27-4c42-85d0-0cc2fe4ba016</serial>
Nov 02 12:14:08 user nova-compute[74534]:     </disk>
Nov 02 12:14:08 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:14:08 user nova-compute[74534]:       <mac address="fa:16:3e:31:93:02"/>
Nov 02 12:14:08 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:14:08 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:14:08 user nova-compute[74534]:       <target dev="tap3704c8b5-ec"/>
Nov 02 12:14:08 user nova-compute[74534]:     </interface>
Nov 02 12:14:08 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:14:08 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a/console.log" append="off"/>
Nov 02 12:14:08 user nova-compute[74534]:     </serial>
Nov 02 12:14:08 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:14:08 user nova-compute[74534]:     <video>
Nov 02 12:14:08 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:14:08 user nova-compute[74534]:     </video>
Nov 02 12:14:08 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:14:08 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:14:08 user nova-compute[74534]:     </rng>
Nov 02 12:14:08 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:14:08 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:14:08 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:14:08 user nova-compute[74534]:     </memballoon>
Nov 02 12:14:08 user nova-compute[74534]:   </devices>
Nov 02 12:14:08 user nova-compute[74534]: </domain>
Nov 02 12:14:08 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1445971962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718226071',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUvT97WEExqR0OQmGwpmELMt+ImPLb1+mXmovwHR4XLPFB0ez6vAOasZmSPO2WheLOO9pmkHuFYo38fre1rCWoG3U01qW0dS1//or12B5d7TtxG9aJO7yiW6xIGkwXZog==',key_name='tempest-keypair-1558372433',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d863bade99ab4f4e946637975a0f7224',ramdisk_id='',reservation_id='r-pec8wqms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1315298848',owner_user_name='tempest-ServerActionsV293TestJSON-1315298848-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3db2c5117c754142978c7a872de22fb4',uuid=a9159e85-6d12-4166-be94-8f8b1620761a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converting VIF {"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG os_vif [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.889s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8dbca30-c6ec-5014-8e2b-3d2613acb6d9', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3704c8b5-ec, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3704c8b5-ec, col_values=(('qos', UUID('3ed14dbb-a6e8-46f0-9268-8ae23e0f97c8')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3704c8b5-ec, col_values=(('external_ids', {'iface-id': '3704c8b5-ecf1-441a-8c0e-9219f2e12835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:93:02', 'vm-uuid': 'a9159e85-6d12-4166-be94-8f8b1620761a'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:08 user nova-compute[74534]: INFO os_vif [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec')
Nov 02 12:14:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:14:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] No VIF found with MAC fa:16:3e:31:93:02, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.policy [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dae37e0cfa414111b89952d130d4fbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c4b94f48eb458589f03332ebb35a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:14:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Creating image(s)
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "/opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "/opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.322s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.258s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk 1073741824" returned: 0 in 0.089s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Successfully created port: 0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.236s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.compute.manager [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-changed-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.compute.manager [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Refreshing instance network info cache due to event network-changed-0318df0b-b216-408e-92a9-92ac03bb706c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] Acquiring lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] Acquired lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.network.neutron [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Refreshing network info cache for port 0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Cannot resize image /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Ensure instance console log exists: /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Successfully updated port: 0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received event network-changed-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Refreshing instance network info cache due to event network-changed-0832c3fe-7b08-4377-a288-a6c58b555f4b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] Acquiring lock "refresh_cache-d4101470-c263-4a46-a0cd-1abae9b9f0bb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] Acquired lock "refresh_cache-d4101470-c263-4a46-a0cd-1abae9b9f0bb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Refreshing network info cache for port 0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:13 user nova-compute[74534]: WARNING nova.compute.manager [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received unexpected event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:13 user nova-compute[74534]: WARNING nova.compute.manager [req-866896af-9f78-4373-b75c-cc05ff3e892d req-49495eed-da9f-4b33-b98d-1fa1ea07a698 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received unexpected event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with vm_state active and task_state rebuild_spawning.
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "refresh_cache-d4101470-c263-4a46-a0cd-1abae9b9f0bb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:14:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:14:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7268MB free_disk=25.148780822753906GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:13 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance spawned successfully.
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 68f79d06-363a-44d0-a74a-4c745558f0ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance a9159e85-6d12-4166-be94-8f8b1620761a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d5330cc9-9437-4276-95f9-7b2909d0e49a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Updated VIF entry in instance network info cache for port 0318df0b-b216-408e-92a9-92ac03bb706c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Updating instance_info_cache with network_info: [{"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0772ffd6-9373-4b66-8712-5f68d531e1d4 req-a82e1216-a434-4f75-8e42-3e16ab83aafe service nova] Releasing lock "refresh_cache-734e86fe-b5c9-4c17-a360-fc7b7999b0bc" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dddb0e3f-57dc-45cb-9cd2-68b496c7226b req-a9d46987-77a1-4ef8-ab3a-1d76a8ca1068 service nova] Releasing lock "refresh_cache-d4101470-c263-4a46-a0cd-1abae9b9f0bb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquired lock "refresh_cache-d4101470-c263-4a46-a0cd-1abae9b9f0bb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.964s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.662s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74534) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Updating instance_info_cache with network_info: [{"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Releasing lock "refresh_cache-d4101470-c263-4a46-a0cd-1abae9b9f0bb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Instance network_info: |[{"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:14:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Start _get_guest_xml network_info=[{"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bec165ff-db05-41ba-9150-cbcc801c4b5c tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.141s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:14:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1747017501',display_name='tempest-ServersNegativeTestJSON-server-1747017501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1747017501',id=25,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c4b94f48eb458589f03332ebb35a87',ramdisk_id='',reservation_id='r-zj5yy3e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1439847488',owner_user_name='tempest-ServersNegativeTestJSON-1439847488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:14:08Z,user_data=None,user_id='dae37e0cfa414111b89952d130d4fbf2',uuid=d4101470-c263-4a46-a0cd-1abae9b9f0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converting VIF {"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=0832c3fe-7b08-4377-a288-a6c58b555f4b,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0832c3fe-7b') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lazy-loading 'pci_devices' on Instance uuid d4101470-c263-4a46-a0cd-1abae9b9f0bb {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:14:15 user nova-compute[74534]:   <uuid>d4101470-c263-4a46-a0cd-1abae9b9f0bb</uuid>
Nov 02 12:14:15 user nova-compute[74534]:   <name>instance-00000019</name>
Nov 02 12:14:15 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:14:15 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:14:15 user nova-compute[74534]:   <metadata>
Nov 02 12:14:15 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:14:15 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:14:15 user nova-compute[74534]:       <nova:name>tempest-ServersNegativeTestJSON-server-1747017501</nova:name>
Nov 02 12:14:15 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:14:15</nova:creationTime>
Nov 02 12:14:15 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:14:15 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:14:15 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:14:15 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:14:15 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:14:15 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:14:15 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:14:15 user nova-compute[74534]:       <nova:owner>
Nov 02 12:14:15 user nova-compute[74534]:         <nova:user uuid="dae37e0cfa414111b89952d130d4fbf2">tempest-ServersNegativeTestJSON-1439847488-project-member</nova:user>
Nov 02 12:14:15 user nova-compute[74534]:         <nova:project uuid="38c4b94f48eb458589f03332ebb35a87">tempest-ServersNegativeTestJSON-1439847488</nova:project>
Nov 02 12:14:15 user nova-compute[74534]:       </nova:owner>
Nov 02 12:14:15 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:14:15 user nova-compute[74534]:       <nova:ports>
Nov 02 12:14:15 user nova-compute[74534]:         <nova:port uuid="0832c3fe-7b08-4377-a288-a6c58b555f4b">
Nov 02 12:14:15 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 12:14:15 user nova-compute[74534]:         </nova:port>
Nov 02 12:14:15 user nova-compute[74534]:       </nova:ports>
Nov 02 12:14:15 user nova-compute[74534]:     </nova:instance>
Nov 02 12:14:15 user nova-compute[74534]:   </metadata>
Nov 02 12:14:15 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:14:15 user nova-compute[74534]:     <system>
Nov 02 12:14:15 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:14:15 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:14:15 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:14:15 user nova-compute[74534]:       <entry name="serial">d4101470-c263-4a46-a0cd-1abae9b9f0bb</entry>
Nov 02 12:14:15 user nova-compute[74534]:       <entry name="uuid">d4101470-c263-4a46-a0cd-1abae9b9f0bb</entry>
Nov 02 12:14:15 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:14:15 user nova-compute[74534]:     </system>
Nov 02 12:14:15 user nova-compute[74534]:   </sysinfo>
Nov 02 12:14:15 user nova-compute[74534]:   <os>
Nov 02 12:14:15 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:14:15 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:14:15 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:14:15 user nova-compute[74534]:   </os>
Nov 02 12:14:15 user nova-compute[74534]:   <features>
Nov 02 12:14:15 user nova-compute[74534]:     <acpi/>
Nov 02 12:14:15 user nova-compute[74534]:     <apic/>
Nov 02 12:14:15 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:14:15 user nova-compute[74534]:   </features>
Nov 02 12:14:15 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:14:15 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:14:15 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:14:15 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:14:15 user nova-compute[74534]:   </clock>
Nov 02 12:14:15 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:14:15 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:14:15 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:14:15 user nova-compute[74534]:   </cpu>
Nov 02 12:14:15 user nova-compute[74534]:   <devices>
Nov 02 12:14:15 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:14:15 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:14:15 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk"/>
Nov 02 12:14:15 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:14:15 user nova-compute[74534]:     </disk>
Nov 02 12:14:15 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:14:15 user nova-compute[74534]:       <mac address="fa:16:3e:b8:a0:f0"/>
Nov 02 12:14:15 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:14:15 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:14:15 user nova-compute[74534]:       <target dev="tap0832c3fe-7b"/>
Nov 02 12:14:15 user nova-compute[74534]:     </interface>
Nov 02 12:14:15 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:14:15 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/console.log" append="off"/>
Nov 02 12:14:15 user nova-compute[74534]:     </serial>
Nov 02 12:14:15 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:14:15 user nova-compute[74534]:     <video>
Nov 02 12:14:15 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:14:15 user nova-compute[74534]:     </video>
Nov 02 12:14:15 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:14:15 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:14:15 user nova-compute[74534]:     </rng>
Nov 02 12:14:15 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:14:15 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:14:15 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:14:15 user nova-compute[74534]:     </memballoon>
Nov 02 12:14:15 user nova-compute[74534]:   </devices>
Nov 02 12:14:15 user nova-compute[74534]: </domain>
Nov 02 12:14:15 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1747017501',display_name='tempest-ServersNegativeTestJSON-server-1747017501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1747017501',id=25,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c4b94f48eb458589f03332ebb35a87',ramdisk_id='',reservation_id='r-zj5yy3e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1439847488',owner_user_name='tempest-ServersNegativeTestJSON-1439847488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:14:08Z,user_data=None,user_id='dae37e0cfa414111b89952d130d4fbf2',uuid=d4101470-c263-4a46-a0cd-1abae9b9f0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converting VIF {"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=0832c3fe-7b08-4377-a288-a6c58b555f4b,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0832c3fe-7b') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG os_vif [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=0832c3fe-7b08-4377-a288-a6c58b555f4b,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0832c3fe-7b') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b636e2f0-d372-5752-bec8-c4248abb58b5', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0832c3fe-7b, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0832c3fe-7b, col_values=(('qos', UUID('655561da-0025-4957-8269-0dd4a6a6e0aa')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0832c3fe-7b, col_values=(('external_ids', {'iface-id': '0832c3fe-7b08-4377-a288-a6c58b555f4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:a0:f0', 'vm-uuid': 'd4101470-c263-4a46-a0cd-1abae9b9f0bb'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:15 user nova-compute[74534]: INFO os_vif [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=0832c3fe-7b08-4377-a288-a6c58b555f4b,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0832c3fe-7b')
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] No VIF found with MAC fa:16:3e:b8:a0:f0, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG nova.objects.instance [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid 734e86fe-b5c9-4c17-a360-fc7b7999b0bc {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-cfacf361-2ea7-4fb1-baf5-4dc896a62664 req-c2961a98-bb62-47a4-bf0f-5a18ee959d7a service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received event network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cfacf361-2ea7-4fb1-baf5-4dc896a62664 req-c2961a98-bb62-47a4-bf0f-5a18ee959d7a service nova] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cfacf361-2ea7-4fb1-baf5-4dc896a62664 req-c2961a98-bb62-47a4-bf0f-5a18ee959d7a service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cfacf361-2ea7-4fb1-baf5-4dc896a62664 req-c2961a98-bb62-47a4-bf0f-5a18ee959d7a service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-cfacf361-2ea7-4fb1-baf5-4dc896a62664 req-c2961a98-bb62-47a4-bf0f-5a18ee959d7a service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] No waiting events found dispatching network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:17 user nova-compute[74534]: WARNING nova.compute.manager [req-cfacf361-2ea7-4fb1-baf5-4dc896a62664 req-c2961a98-bb62-47a4-bf0f-5a18ee959d7a service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received unexpected event network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b for instance with vm_state building and task_state spawning.
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:17 user nova-compute[74534]: INFO nova.compute.manager [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Attaching volume ca38e8fb-9be4-4979-9a40-3f6ab1d7baee to /dev/vdb
Nov 02 12:14:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG os_brick.utils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc695a-d379-498f-80b6-beeace685499]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[32863c8b-4306-474c-a954-dbc51e526341]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f738d5e-8276-4920-a1b6-323c0a1698f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e44409-b2a7-4967-b177-2803f8601cb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:14:17 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:14:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c70dc1-816e-4354-be78-c87732592496]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG os_brick.utils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:14:17 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Updating existing volume attachment record: 4e3263c2-13bf-4164-9c4e-89c1cdbdf836 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:14:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-f86382f7-1cd6-47ae-aed8-56db28fa2d97 req-07919281-6087-4627-b7e2-c65e5db3e670 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received event network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f86382f7-1cd6-47ae-aed8-56db28fa2d97 req-07919281-6087-4627-b7e2-c65e5db3e670 service nova] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f86382f7-1cd6-47ae-aed8-56db28fa2d97 req-07919281-6087-4627-b7e2-c65e5db3e670 service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f86382f7-1cd6-47ae-aed8-56db28fa2d97 req-07919281-6087-4627-b7e2-c65e5db3e670 service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-f86382f7-1cd6-47ae-aed8-56db28fa2d97 req-07919281-6087-4627-b7e2-c65e5db3e670 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] No waiting events found dispatching network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:19 user nova-compute[74534]: WARNING nova.compute.manager [req-f86382f7-1cd6-47ae-aed8-56db28fa2d97 req-07919281-6087-4627-b7e2-c65e5db3e670 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received unexpected event network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b for instance with vm_state building and task_state spawning.
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:14:19 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Instance spawned successfully.
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:14:19 user nova-compute[74534]: INFO nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Took 11.12 seconds to spawn the instance on the hypervisor.
Nov 02 12:14:19 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:14:19 user nova-compute[74534]: INFO nova.compute.manager [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Took 12.51 seconds to build instance.
Nov 02 12:14:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d6d85b6a-f942-450a-ba4b-52d1cace3e00 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.840s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:23 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e is timed out.
Nov 02 12:14:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully detached device vdb from instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e from the live domain config.
Nov 02 12:14:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FibhWnwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:14:23 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf89c496-7e60-48e1-b1d5-ec4991b56c3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:14:23 user nova-compute[74534]: No targets found.
Nov 02 12:14:23 user nova-compute[74534]: iSNS:
Nov 02 12:14:23 user nova-compute[74534]: No targets found.
Nov 02 12:14:23 user nova-compute[74534]: STATIC:
Nov 02 12:14:23 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321
Nov 02 12:14:23 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:14:23 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:14:23 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016
Nov 02 12:14:23 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:14:23 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:14:23 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:14:23 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:14:23 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:14:23 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:14:23 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:14:23 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:14:23 user nova-compute[74534]: FIRMWARE:
Nov 02 12:14:23 user nova-compute[74534]: No targets found.
Nov 02 12:14:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:14:23 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:14:23 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79793ee-9ad9-4a2a-8f0e-243f28be794b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc6ec2-667b-4f40-b7d4-682ea4b116ab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:23 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:14:23 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:23 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:23 user nova-compute[74534]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 (non-flash)
Nov 02 12:14:23 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:23 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1804c4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321'): ({'sde'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Removing single pathed devices sde {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[47898fe3-3211-41c4-94b5-efe2cbc139ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ed630f-2f7a-4781-9cd3-5cdb940c4c18]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flushing IO for device /dev/sde {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db2ef9-8217-44f3-9951-12630951e7ea]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1336fb99-6fa2-47fb-9a52-2a406010d524]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafb468f-9c02-46a8-b06d-39c27af917bf]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d06487b-0ab7-4a23-b6f5-a823fba26579]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260]
Nov 02 12:14:23 user nova-compute[74534]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321, portal: 172.16.0.220,3260] successful.
Nov 02 12:14:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b6a609-c704-4b97-99c0-03babdd70321 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[471daf7f-b2d0-4a05-bd67-dba8053680ef]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== disconnect_volume: return (365ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:14:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:14:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:25 user nova-compute[74534]: DEBUG nova.objects.instance [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'flavor' on Instance uuid 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-15a6ac86-bf9f-4b70-8c03-fe5ae600d505 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.756s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:28 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68f79d06-363a-44d0-a74a-4c745558f0ea is timed out.
Nov 02 12:14:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Successfully detached device vdb from instance 68f79d06-363a-44d0-a74a-4c745558f0ea from the live domain config.
Nov 02 12:14:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YroTkOBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:14:28 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[36befb8d-171a-4275-9641-14b82e57aeac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:14:28 user nova-compute[74534]: No targets found.
Nov 02 12:14:28 user nova-compute[74534]: iSNS:
Nov 02 12:14:28 user nova-compute[74534]: No targets found.
Nov 02 12:14:28 user nova-compute[74534]: STATIC:
Nov 02 12:14:28 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016
Nov 02 12:14:28 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:14:28 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:14:28 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d
Nov 02 12:14:28 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:14:28 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:14:28 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:14:28 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:14:28 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:14:28 user nova-compute[74534]: FIRMWARE:
Nov 02 12:14:28 user nova-compute[74534]: No targets found.
Nov 02 12:14:28 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:14:28 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:14:28 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c13804-ae32-4d18-8059-25b28cd4e17b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e58d5f1-5f7e-4e34-9828-3c46601f645b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:28 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:28 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:28 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:28 user nova-compute[74534]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d (non-flash)
Nov 02 12:14:28 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:28 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c64c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f10649-2acb-49f9-ab4e-6a79987cfa80]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2b70b0-bfb9-4446-87da-9a4878369859]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[042eac09-27ce-407e-8ba1-ccebf3db01f4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[76863984-1a88-4327-8ce3-d1ce5994b573]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d40b4-76cc-45af-919e-5feb968f721a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a90aba-d2a3-480d-ace7-5d81d2566981]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260]
Nov 02 12:14:28 user nova-compute[74534]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d, portal: 172.16.0.220,3260] successful.
Nov 02 12:14:28 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab4e4bc-5dbf-4d4e-8941-2f6e4472231d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e400c-0fa6-4c29-aad3-35d1b5a5e488]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] <== disconnect_volume: return (389ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:14:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:14:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:33 user nova-compute[74534]: DEBUG nova.objects.instance [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lazy-loading 'flavor' on Instance uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-07f95f0a-a539-41eb-a490-16013c1f95a8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.592s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcFoVMyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:14:41 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:14:41 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:14:41 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f9d045-bce0-423d-91db-7a79f47eec77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:14:41 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db7a1c-6efa-4acf-a41e-1e9df74428de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee] added
Nov 02 12:14:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed952269-dc84-4d51-9084-a78351c1aa79]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf2f714-596f-486d-80d6-ed3a8eaca68e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcFoVMyB {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcFoVMyB" returned: 0 in 0.058s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7c81c0-96db-442a-ba66-8365f84f9af5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UcFoVMyB'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2879e663-e6eb-489b-856f-b6a70662a67b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b308c-332f-45ec-9b4f-e85a73639247]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379bdea-ce33-4c4f-a493-2991e21106fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260]
Nov 02 12:14:41 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260] successful.
Nov 02 12:14:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e952e-5185-4690-8dcd-2664ab92dc0e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca21e4b7-6b2a-4016-a56a-dc661135a024]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee (non-flash)
Nov 02 12:14:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:14:41 user nova-compute[74534]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee (non-flash)
Nov 02 12:14:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5aaa21-f602-429a-994d-ed87ba5e238f]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:14:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:14:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:14:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcFoVMyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:14:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:14:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26166336633343361', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:14:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166336633343361', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:14:42 user nova-compute[74534]: DEBUG nova.objects.instance [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid 734e86fe-b5c9-4c17-a360-fc7b7999b0bc {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:14:42 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:42 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:14:42 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:14:42 user nova-compute[74534]:   <serial>ca38e8fb-9be4-4979-9a40-3f6ab1d7baee</serial>
Nov 02 12:14:42 user nova-compute[74534]: </disk>
Nov 02 12:14:42 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:14:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:14:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:14:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No VIF found with MAC fa:16:3e:44:ac:fb, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:14:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-152f7b0a-4171-4137-90b9-c1ac04f45a29 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.740s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:44 user nova-compute[74534]: INFO nova.compute.manager [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Detaching volume ca38e8fb-9be4-4979-9a40-3f6ab1d7baee
Nov 02 12:14:44 user nova-compute[74534]: INFO nova.virt.block_device [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Attempting to driver detach volume ca38e8fb-9be4-4979-9a40-3f6ab1d7baee from mountpoint /dev/vdb
Nov 02 12:14:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Attempting to detach device vdb from instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:14:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:14:44 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:44 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:14:44 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:14:44 user nova-compute[74534]:   <serial>ca38e8fb-9be4-4979-9a40-3f6ab1d7baee</serial>
Nov 02 12:14:44 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:14:44 user nova-compute[74534]: </disk>
Nov 02 12:14:44 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:14:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully detached device vdb from instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc from the persistent domain config.
Nov 02 12:14:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:14:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:14:44 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:14:44 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:14:44 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:14:44 user nova-compute[74534]:   <serial>ca38e8fb-9be4-4979-9a40-3f6ab1d7baee</serial>
Nov 02 12:14:44 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:14:44 user nova-compute[74534]: </disk>
Nov 02 12:14:44 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:14:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:14:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:53 user nova-compute[74534]: INFO nova.compute.manager [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Terminating instance
Nov 02 12:14:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-da873998-970d-44b5-bc9c-6557f638a8f2 req-f5f35949-cee4-47df-a918-980e20b9e4cb service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-unplugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-da873998-970d-44b5-bc9c-6557f638a8f2 req-f5f35949-cee4-47df-a918-980e20b9e4cb service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-da873998-970d-44b5-bc9c-6557f638a8f2 req-f5f35949-cee4-47df-a918-980e20b9e4cb service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-da873998-970d-44b5-bc9c-6557f638a8f2 req-f5f35949-cee4-47df-a918-980e20b9e4cb service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-da873998-970d-44b5-bc9c-6557f638a8f2 req-f5f35949-cee4-47df-a918-980e20b9e4cb service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-unplugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-da873998-970d-44b5-bc9c-6557f638a8f2 req-f5f35949-cee4-47df-a918-980e20b9e4cb service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-unplugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:14:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Instance destroyed successfully.
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.objects.instance [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'resources' on Instance uuid 530fbde9-c0cf-4f20-9b7c-b91296394e2e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-494432744',display_name='tempest-ServerActionsTestOtherA-server-998874074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-494432744',id=15,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0Er+iV0JuqGua4bxljSzid6e+SBjxx22nRQ+h73MhbqL5/talrrpwV6bPTgkxz82FgRzDTXzhYgQCd6uha9SECrsSRu7T8feWG69VkQgQbXnJ9BhWbbsv4PIJhs9P1cg==',key_name='tempest-keypair-2079383095',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:11:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-g4t4y7wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=530fbde9-c0cf-4f20-9b7c-b91296394e2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "address": "fa:16:3e:b9:fb:c9", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf1e966f-35", "ovs_interfaceid": "df1e966f-35ba-4e1e-b92b-e35ba3d79b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG os_vif [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf1e966f-35, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c257d70-3fd0-45f0-97ef-bc4e92b73521) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:54 user nova-compute[74534]: INFO os_vif [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:fb:c9,bridge_name='br-int',has_traffic_filtering=True,id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf1e966f-35')
Nov 02 12:14:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Deleting instance files /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e_del
Nov 02 12:14:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Deletion of /opt/stack/data/nova/instances/530fbde9-c0cf-4f20-9b7c-b91296394e2e_del complete
Nov 02 12:14:54 user nova-compute[74534]: INFO nova.compute.manager [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 02 12:14:54 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:14:54 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:14:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:55 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:55 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Took 1.11 seconds to deallocate network for instance.
Nov 02 12:14:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-4691302a-8aa6-4f23-9ac7-4728f5f1e78c req-b6bf6a84-6ec5-461e-98b3-b3bea9aba4c0 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-deleted-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:55 user nova-compute[74534]: INFO nova.compute.manager [req-4691302a-8aa6-4f23-9ac7-4728f5f1e78c req-b6bf6a84-6ec5-461e-98b3-b3bea9aba4c0 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Neutron deleted interface df1e966f-35ba-4e1e-b92b-e35ba3d79b61; detaching it from the instance and deleting it from the info cache
Nov 02 12:14:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-4691302a-8aa6-4f23-9ac7-4728f5f1e78c req-b6bf6a84-6ec5-461e-98b3-b3bea9aba4c0 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-4691302a-8aa6-4f23-9ac7-4728f5f1e78c req-b6bf6a84-6ec5-461e-98b3-b3bea9aba4c0 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Detach interface failed, port_id=df1e966f-35ba-4e1e-b92b-e35ba3d79b61, reason: Instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:14:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:55 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:14:55 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:56 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Deleted allocations for instance 530fbde9-c0cf-4f20-9b7c-b91296394e2e
Nov 02 12:14:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-bd2db55e-3b74-48ef-903c-d473a4b8865b req-36279790-642f-4640-806a-58596be4c3e8 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd2db55e-3b74-48ef-903c-d473a4b8865b req-36279790-642f-4640-806a-58596be4c3e8 service nova] Acquiring lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd2db55e-3b74-48ef-903c-d473a4b8865b req-36279790-642f-4640-806a-58596be4c3e8 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd2db55e-3b74-48ef-903c-d473a4b8865b req-36279790-642f-4640-806a-58596be4c3e8 service nova] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-bd2db55e-3b74-48ef-903c-d473a4b8865b req-36279790-642f-4640-806a-58596be4c3e8 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] No waiting events found dispatching network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:56 user nova-compute[74534]: WARNING nova.compute.manager [req-bd2db55e-3b74-48ef-903c-d473a4b8865b req-36279790-642f-4640-806a-58596be4c3e8 service nova] [instance: 530fbde9-c0cf-4f20-9b7c-b91296394e2e] Received unexpected event network-vif-plugged-df1e966f-35ba-4e1e-b92b-e35ba3d79b61 for instance with vm_state deleted and task_state None.
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d8257cc-7e6a-4155-9947-e6439848d09d tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "530fbde9-c0cf-4f20-9b7c-b91296394e2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:14:56 user nova-compute[74534]: INFO nova.compute.claims [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Claim successful on node user
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:14:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:57 user nova-compute[74534]: INFO nova.compute.manager [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Terminating instance
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.policy [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba022690804d4ec3a38b404666dc48c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf02bd3efdd416e93fb6cf48374640d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:14:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Creating image(s)
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "/opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "/opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "/opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.246s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-c8f72d10-64e1-463b-8327-5bd013cf7c29 req-fd663d15-b2ae-4457-80fe-3451ecd2b5e1 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-vif-unplugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c8f72d10-64e1-463b-8327-5bd013cf7c29 req-fd663d15-b2ae-4457-80fe-3451ecd2b5e1 service nova] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c8f72d10-64e1-463b-8327-5bd013cf7c29 req-fd663d15-b2ae-4457-80fe-3451ecd2b5e1 service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c8f72d10-64e1-463b-8327-5bd013cf7c29 req-fd663d15-b2ae-4457-80fe-3451ecd2b5e1 service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-c8f72d10-64e1-463b-8327-5bd013cf7c29 req-fd663d15-b2ae-4457-80fe-3451ecd2b5e1 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] No waiting events found dispatching network-vif-unplugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-c8f72d10-64e1-463b-8327-5bd013cf7c29 req-fd663d15-b2ae-4457-80fe-3451ecd2b5e1 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-vif-unplugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk 1073741824" returned: 0 in 0.077s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Instance destroyed successfully.
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.objects.instance [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lazy-loading 'resources' on Instance uuid 68f79d06-363a-44d0-a74a-4c745558f0ea {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1433026891',display_name='tempest-TestVolumeSwap-server-1433026891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1433026891',id=17,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuGHy77k7thjYtCg5qXrYtEYyznFMi83dyWxz6YRtbByMlq6lCUDtIKDSbEjzHwnqokwXBmSbWqI/naWm4K/lkktg0zUdoVHw+MC+C3oRgCDr57cphWNeS+mGIeUwPrKw==',key_name='tempest-keypair-1671246879',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:10:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4d9a8ef7434eb9838bd0cf15f8c25b',ramdisk_id='',reservation_id='r-ou6a08x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1825163514',owner_user_name='tempest-TestVolumeSwap-1825163514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:10:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='229100ec64ca41c29e10777e20031198',uuid=68f79d06-363a-44d0-a74a-4c745558f0ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Converting VIF {"id": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "address": "fa:16:3e:e9:ab:e7", "network": {"id": "9d10b72f-bedd-4548-a6ce-b68d9964c427", "bridge": "br-int", "label": "tempest-TestVolumeSwap-276330124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4d9a8ef7434eb9838bd0cf15f8c25b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21a2de97-57", "ovs_interfaceid": "21a2de97-57de-4c7e-ac4d-0d91cc3fcd92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92,network=Network(9d10b72f-bedd-4548-a6ce-b68d9964c427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21a2de97-57') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG os_vif [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92,network=Network(9d10b72f-bedd-4548-a6ce-b68d9964c427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21a2de97-57') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21a2de97-57, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=442f47b3-d23e-4b36-902c-d92049b04d35) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:14:58 user nova-compute[74534]: INFO os_vif [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ab:e7,bridge_name='br-int',has_traffic_filtering=True,id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92,network=Network(9d10b72f-bedd-4548-a6ce-b68d9964c427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21a2de97-57')
Nov 02 12:14:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Deleting instance files /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea_del
Nov 02 12:14:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Deletion of /opt/stack/data/nova/instances/68f79d06-363a-44d0-a74a-4c745558f0ea_del complete
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:14:58 user nova-compute[74534]: INFO nova.compute.manager [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Successfully created port: 57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Cannot resize image /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Ensure instance console log exists: /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:59 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Took 1.19 seconds to deallocate network for instance.
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-20df6cb8-4ed9-4311-8c8d-5ae992602e3c req-9db3fff8-a96a-43de-8f01-0c8241c1377b service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-vif-deleted-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:14:59 user nova-compute[74534]: INFO nova.compute.manager [req-20df6cb8-4ed9-4311-8c8d-5ae992602e3c req-9db3fff8-a96a-43de-8f01-0c8241c1377b service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Neutron deleted interface 21a2de97-57de-4c7e-ac4d-0d91cc3fcd92; detaching it from the instance and deleting it from the info cache
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-20df6cb8-4ed9-4311-8c8d-5ae992602e3c req-9db3fff8-a96a-43de-8f01-0c8241c1377b service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Successfully updated port: 57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquired lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-20df6cb8-4ed9-4311-8c8d-5ae992602e3c req-9db3fff8-a96a-43de-8f01-0c8241c1377b service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Detach interface failed, port_id=21a2de97-57de-4c7e-ac4d-0d91cc3fcd92, reason: Instance 68f79d06-363a-44d0-a74a-4c745558f0ea could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:14:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updating instance_info_cache with network_info: [{"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Releasing lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Instance network_info: |[{"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Start _get_guest_xml network_info=[{"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:15:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:15:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-785231472',display_name='tempest-TestServerVolumeAttachmentScenario-server-785231472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-785231472',id=26,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFLFrWKZfXjwbl3fYKXgHZZB0GmgPPncDFWdwpiQwMYzeapzmKkQyRDD+gmq4hU+NH+fAh541pFruLBAmVhEEzx7nOP+Z7CwKejLHgKD7bcwZ/ERUHSWztpIOgkzE5wag==',key_name='tempest-keypair-717906883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acf02bd3efdd416e93fb6cf48374640d',ramdisk_id='',reservation_id='r-ywdmr5m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-657705089',owner_user_name='tempest-TestServerVolumeAttachmentScenario-657705089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba022690804d4ec3a38b404666dc48c7',uuid=75b42e29-aba9-462e-bfe8-a9075c7c10ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Converting VIF {"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=57ec1a30-0005-4023-9cf9-1fe8a034a53e,network=Network(dd1b6ad4-082e-4822-9610-f7c83a6e2fd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ec1a30-00') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'pci_devices' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:15:00 user nova-compute[74534]:   <uuid>75b42e29-aba9-462e-bfe8-a9075c7c10ff</uuid>
Nov 02 12:15:00 user nova-compute[74534]:   <name>instance-0000001a</name>
Nov 02 12:15:00 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:15:00 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:15:00 user nova-compute[74534]:   <metadata>
Nov 02 12:15:00 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:15:00 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:15:00 user nova-compute[74534]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-785231472</nova:name>
Nov 02 12:15:00 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:15:00</nova:creationTime>
Nov 02 12:15:00 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:15:00 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:15:00 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:15:00 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:15:00 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:15:00 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:15:00 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:15:00 user nova-compute[74534]:       <nova:owner>
Nov 02 12:15:00 user nova-compute[74534]:         <nova:user uuid="ba022690804d4ec3a38b404666dc48c7">tempest-TestServerVolumeAttachmentScenario-657705089-project-member</nova:user>
Nov 02 12:15:00 user nova-compute[74534]:         <nova:project uuid="acf02bd3efdd416e93fb6cf48374640d">tempest-TestServerVolumeAttachmentScenario-657705089</nova:project>
Nov 02 12:15:00 user nova-compute[74534]:       </nova:owner>
Nov 02 12:15:00 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:15:00 user nova-compute[74534]:       <nova:ports>
Nov 02 12:15:00 user nova-compute[74534]:         <nova:port uuid="57ec1a30-0005-4023-9cf9-1fe8a034a53e">
Nov 02 12:15:00 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:15:00 user nova-compute[74534]:         </nova:port>
Nov 02 12:15:00 user nova-compute[74534]:       </nova:ports>
Nov 02 12:15:00 user nova-compute[74534]:     </nova:instance>
Nov 02 12:15:00 user nova-compute[74534]:   </metadata>
Nov 02 12:15:00 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:15:00 user nova-compute[74534]:     <system>
Nov 02 12:15:00 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:15:00 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:15:00 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:15:00 user nova-compute[74534]:       <entry name="serial">75b42e29-aba9-462e-bfe8-a9075c7c10ff</entry>
Nov 02 12:15:00 user nova-compute[74534]:       <entry name="uuid">75b42e29-aba9-462e-bfe8-a9075c7c10ff</entry>
Nov 02 12:15:00 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:15:00 user nova-compute[74534]:     </system>
Nov 02 12:15:00 user nova-compute[74534]:   </sysinfo>
Nov 02 12:15:00 user nova-compute[74534]:   <os>
Nov 02 12:15:00 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:15:00 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:15:00 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:15:00 user nova-compute[74534]:   </os>
Nov 02 12:15:00 user nova-compute[74534]:   <features>
Nov 02 12:15:00 user nova-compute[74534]:     <acpi/>
Nov 02 12:15:00 user nova-compute[74534]:     <apic/>
Nov 02 12:15:00 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:15:00 user nova-compute[74534]:   </features>
Nov 02 12:15:00 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:15:00 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:15:00 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:15:00 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:15:00 user nova-compute[74534]:   </clock>
Nov 02 12:15:00 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:15:00 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:15:00 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:15:00 user nova-compute[74534]:   </cpu>
Nov 02 12:15:00 user nova-compute[74534]:   <devices>
Nov 02 12:15:00 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:15:00 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:15:00 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk"/>
Nov 02 12:15:00 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:15:00 user nova-compute[74534]:     </disk>
Nov 02 12:15:00 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:15:00 user nova-compute[74534]:       <mac address="fa:16:3e:11:6f:36"/>
Nov 02 12:15:00 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:15:00 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:15:00 user nova-compute[74534]:       <target dev="tap57ec1a30-00"/>
Nov 02 12:15:00 user nova-compute[74534]:     </interface>
Nov 02 12:15:00 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:15:00 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/console.log" append="off"/>
Nov 02 12:15:00 user nova-compute[74534]:     </serial>
Nov 02 12:15:00 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:15:00 user nova-compute[74534]:     <video>
Nov 02 12:15:00 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:15:00 user nova-compute[74534]:     </video>
Nov 02 12:15:00 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:15:00 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:15:00 user nova-compute[74534]:     </rng>
Nov 02 12:15:00 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:15:00 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:15:00 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:15:00 user nova-compute[74534]:     </memballoon>
Nov 02 12:15:00 user nova-compute[74534]:   </devices>
Nov 02 12:15:00 user nova-compute[74534]: </domain>
Nov 02 12:15:00 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-785231472',display_name='tempest-TestServerVolumeAttachmentScenario-server-785231472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-785231472',id=26,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFLFrWKZfXjwbl3fYKXgHZZB0GmgPPncDFWdwpiQwMYzeapzmKkQyRDD+gmq4hU+NH+fAh541pFruLBAmVhEEzx7nOP+Z7CwKejLHgKD7bcwZ/ERUHSWztpIOgkzE5wag==',key_name='tempest-keypair-717906883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acf02bd3efdd416e93fb6cf48374640d',ramdisk_id='',reservation_id='r-ywdmr5m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-657705089',owner_user_name='tempest-TestServerVolumeAttachmentScenario-657705089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba022690804d4ec3a38b404666dc48c7',uuid=75b42e29-aba9-462e-bfe8-a9075c7c10ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Converting VIF {"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=57ec1a30-0005-4023-9cf9-1fe8a034a53e,network=Network(dd1b6ad4-082e-4822-9610-f7c83a6e2fd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ec1a30-00') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG os_vif [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=57ec1a30-0005-4023-9cf9-1fe8a034a53e,network=Network(dd1b6ad4-082e-4822-9610-f7c83a6e2fd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ec1a30-00') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e260e6ba-f8ab-5a7b-9ab4-5cebef4de8ac', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57ec1a30-00, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57ec1a30-00, col_values=(('qos', UUID('2e585aec-77a5-417a-a130-88df25523e33')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57ec1a30-00, col_values=(('external_ids', {'iface-id': '57ec1a30-0005-4023-9cf9-1fe8a034a53e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:6f:36', 'vm-uuid': '75b42e29-aba9-462e-bfe8-a9075c7c10ff'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-29dc4ae4-ba65-418f-b11e-96cb8dfccf5e req-ea25eaee-d07f-4831-8f02-93a763937863 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received event network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-29dc4ae4-ba65-418f-b11e-96cb8dfccf5e req-ea25eaee-d07f-4831-8f02-93a763937863 service nova] Acquiring lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-29dc4ae4-ba65-418f-b11e-96cb8dfccf5e req-ea25eaee-d07f-4831-8f02-93a763937863 service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-29dc4ae4-ba65-418f-b11e-96cb8dfccf5e req-ea25eaee-d07f-4831-8f02-93a763937863 service nova] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-29dc4ae4-ba65-418f-b11e-96cb8dfccf5e req-ea25eaee-d07f-4831-8f02-93a763937863 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] No waiting events found dispatching network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:00 user nova-compute[74534]: WARNING nova.compute.manager [req-29dc4ae4-ba65-418f-b11e-96cb8dfccf5e req-ea25eaee-d07f-4831-8f02-93a763937863 service nova] [instance: 68f79d06-363a-44d0-a74a-4c745558f0ea] Received unexpected event network-vif-plugged-21a2de97-57de-4c7e-ac4d-0d91cc3fcd92 for instance with vm_state deleted and task_state None.
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:00 user nova-compute[74534]: INFO os_vif [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=57ec1a30-0005-4023-9cf9-1fe8a034a53e,network=Network(dd1b6ad4-082e-4822-9610-f7c83a6e2fd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ec1a30-00')
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No VIF found with MAC fa:16:3e:11:6f:36, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:15:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:00 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Deleted allocations for instance 68f79d06-363a-44d0-a74a-4c745558f0ea
Nov 02 12:15:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9762013d-072c-484f-bf6b-0a4f4d70b3b8 tempest-TestVolumeSwap-1825163514 tempest-TestVolumeSwap-1825163514-project-member] Lock "68f79d06-363a-44d0-a74a-4c745558f0ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.976s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-changed-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Refreshing instance network info cache due to event network-changed-57ec1a30-0005-4023-9cf9-1fe8a034a53e. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] Acquiring lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] Acquired lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:15:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Refreshing network info cache for port 57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:15:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:02 user nova-compute[74534]: DEBUG nova.network.neutron [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updated VIF entry in instance network info cache for port 57ec1a30-0005-4023-9cf9-1fe8a034a53e. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:15:02 user nova-compute[74534]: DEBUG nova.network.neutron [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updating instance_info_cache with network_info: [{"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:15:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f95f7896-8b6a-4526-bcbb-62043cd57ce2 req-8b75828b-38e4-4494-aa22-4a0c03e5afd4 service nova] Releasing lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] No waiting events found dispatching network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:03 user nova-compute[74534]: WARNING nova.compute.manager [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received unexpected event network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e for instance with vm_state building and task_state spawning.
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] No waiting events found dispatching network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:03 user nova-compute[74534]: WARNING nova.compute.manager [req-aa61fb23-8c67-4a17-a68e-1328efc3eee1 req-84902de2-a409-4025-b906-d5c8b3fc42da service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received unexpected event network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e for instance with vm_state building and task_state spawning.
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:15:03 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Instance spawned successfully.
Nov 02 12:15:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:15:04 user nova-compute[74534]: INFO nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:04 user nova-compute[74534]: INFO nova.compute.manager [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Took 7.34 seconds to build instance.
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ae566f52-8890-4c34-8c7a-af40aa1e1f6d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.450s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc is timed out.
Nov 02 12:15:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully detached device vdb from instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc from the live domain config.
Nov 02 12:15:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcFoVMyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:15:05 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc086a-34ba-4ca3-8173-0bfd98f97cb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:15:05 user nova-compute[74534]: No targets found.
Nov 02 12:15:05 user nova-compute[74534]: iSNS:
Nov 02 12:15:05 user nova-compute[74534]: No targets found.
Nov 02 12:15:05 user nova-compute[74534]: STATIC:
Nov 02 12:15:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016
Nov 02 12:15:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:15:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:15:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee
Nov 02 12:15:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:15:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:15:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:15:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:15:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:15:05 user nova-compute[74534]: FIRMWARE:
Nov 02 12:15:05 user nova-compute[74534]: No targets found.
Nov 02 12:15:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:15:05 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:15:05 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1acf15d-e7ea-4c8d-8cf0-a67866df850e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2db7c58-0cb4-47c2-9f39-45692df9a894]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:15:05 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:15:05 user nova-compute[74534]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee (non-flash)
Nov 02 12:15:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:15:05 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:15:05 user nova-compute[74534]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee (non-flash)
Nov 02 12:15:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1804c67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5874ed66-363a-4ffa-aa36-1988eedbdaa9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa6f603-95a5-4657-a73b-e26fd23807f3]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02898bb-6af0-495b-a5cc-7c3bb1aa7420]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfecdb9-e582-4097-9df0-4835b8f3f274]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d3c1f4-8b78-488d-a012-b12a88147aca]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ae0171-a3ca-489e-a1e5-4fea62e11fc8]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260]
Nov 02 12:15:05 user nova-compute[74534]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee, portal: 172.16.0.220,3260] successful.
Nov 02 12:15:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca38e8fb-9be4-4979-9a40-3f6ab1d7baee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c61d7b-a1c3-4fa3-af92-44f5695d54cf]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== disconnect_volume: return (413ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG nova.objects.instance [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid 734e86fe-b5c9-4c17-a360-fc7b7999b0bc {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-22ac80a4-328c-45cc-932b-78cb24d0fd36 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.084s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:09 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:15:09 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=6954MB free_disk=25.129650115966797GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance a9159e85-6d12-4166-be94-8f8b1620761a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d5330cc9-9437-4276-95f9-7b2909d0e49a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:15:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:15:10 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:15:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:15:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:15:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:15:23 user nova-compute[74534]: INFO nova.compute.manager [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] instance snapshotting
Nov 02 12:15:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Beginning live snapshot process
Nov 02 12:15:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.228s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4zxxqks9/f5428559a8e8477c84288a7840310e0e.delta 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4zxxqks9/f5428559a8e8477c84288a7840310e0e.delta 1073741824" returned: 0 in 0.075s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 12:15:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:15:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:15:25 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 12:15:25 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:15:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4zxxqks9/f5428559a8e8477c84288a7840310e0e.delta /opt/stack/data/nova/instances/snapshots/tmp4zxxqks9/f5428559a8e8477c84288a7840310e0e {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4zxxqks9/f5428559a8e8477c84288a7840310e0e.delta /opt/stack/data/nova/instances/snapshots/tmp4zxxqks9/f5428559a8e8477c84288a7840310e0e" returned: 0 in 0.758s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Snapshot extracted, beginning image upload
Nov 02 12:15:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:29 user nova-compute[74534]: INFO nova.compute.manager [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Terminating instance
Nov 02 12:15:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:15:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Snapshot image upload complete
Nov 02 12:15:29 user nova-compute[74534]: INFO nova.compute.manager [None req-a8b591db-7eb8-4f68-b859-ddc012977a95 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Took 6.17 seconds to snapshot the instance on the hypervisor.
Nov 02 12:15:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-49b54c68-b476-4044-92aa-3bdb4cf617a8 req-0a6c1043-d5da-498a-a2bf-6de12206eb4a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-49b54c68-b476-4044-92aa-3bdb4cf617a8 req-0a6c1043-d5da-498a-a2bf-6de12206eb4a service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-49b54c68-b476-4044-92aa-3bdb4cf617a8 req-0a6c1043-d5da-498a-a2bf-6de12206eb4a service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-49b54c68-b476-4044-92aa-3bdb4cf617a8 req-0a6c1043-d5da-498a-a2bf-6de12206eb4a service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-49b54c68-b476-4044-92aa-3bdb4cf617a8 req-0a6c1043-d5da-498a-a2bf-6de12206eb4a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-49b54c68-b476-4044-92aa-3bdb4cf617a8 req-0a6c1043-d5da-498a-a2bf-6de12206eb4a service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-unplugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:15:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Instance destroyed successfully.
Nov 02 12:15:30 user nova-compute[74534]: DEBUG nova.objects.instance [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'resources' on Instance uuid ed72d4f3-1405-4e45-8c51-68b6fa57a3c1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-884397019',display_name='tempest-AttachVolumeTestJSON-server-884397019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-884397019',id=4,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYB5LXg74gp0aknocxgXcmt3Lfa2vkl0HkmpHX0nZVnqlBe4+JzYk67ZUGHfD3RJDfhaVSP28N51o6EufAhqLa0ifLgUwpswAMMAcUNfvkssZJEOX9yqknHhFULB3j+xw==',key_name='tempest-keypair-1147341102',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-4z08020a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:13:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=ed72d4f3-1405-4e45-8c51-68b6fa57a3c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "address": "fa:16:3e:72:88:5c", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86a40-46", "ovs_interfaceid": "77f86a40-464c-4f30-a11d-abf8b4a7f8d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG os_vif [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f86a40-46, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0ef4f79-6b81-495c-88ea-e85b8eaeb4ee) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:30 user nova-compute[74534]: INFO os_vif [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=77f86a40-464c-4f30-a11d-abf8b4a7f8d4,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86a40-46')
Nov 02 12:15:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Deleting instance files /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1_del
Nov 02 12:15:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Deletion of /opt/stack/data/nova/instances/ed72d4f3-1405-4e45-8c51-68b6fa57a3c1_del complete
Nov 02 12:15:30 user nova-compute[74534]: INFO nova.compute.manager [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 02 12:15:30 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:15:30 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:15:30 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Took 0.74 seconds to deallocate network for instance.
Nov 02 12:15:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-09a7a6ae-cf16-4c1f-b6d5-d52002f16e4b req-371e675c-26f2-4ce0-9460-4b8574013bab service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-deleted-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:31 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Deleted allocations for instance ed72d4f3-1405-4e45-8c51-68b6fa57a3c1
Nov 02 12:15:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-74efb446-f253-41ef-8aa6-0a1a75ffdff1 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.189s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-d7be38a4-f499-461b-9a6b-1ed863d96feb req-1c6422d9-4b58-4022-ae2d-2ade16f4d6e5 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d7be38a4-f499-461b-9a6b-1ed863d96feb req-1c6422d9-4b58-4022-ae2d-2ade16f4d6e5 service nova] Acquiring lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d7be38a4-f499-461b-9a6b-1ed863d96feb req-1c6422d9-4b58-4022-ae2d-2ade16f4d6e5 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d7be38a4-f499-461b-9a6b-1ed863d96feb req-1c6422d9-4b58-4022-ae2d-2ade16f4d6e5 service nova] Lock "ed72d4f3-1405-4e45-8c51-68b6fa57a3c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-d7be38a4-f499-461b-9a6b-1ed863d96feb req-1c6422d9-4b58-4022-ae2d-2ade16f4d6e5 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] No waiting events found dispatching network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:31 user nova-compute[74534]: WARNING nova.compute.manager [req-d7be38a4-f499-461b-9a6b-1ed863d96feb req-1c6422d9-4b58-4022-ae2d-2ade16f4d6e5 service nova] [instance: ed72d4f3-1405-4e45-8c51-68b6fa57a3c1] Received unexpected event network-vif-plugged-77f86a40-464c-4f30-a11d-abf8b4a7f8d4 for instance with vm_state deleted and task_state None.
Nov 02 12:15:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:35 user nova-compute[74534]: INFO nova.compute.manager [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Terminating instance
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-e6bcdbde-0af3-4d5c-a8dd-eb0443e2ffbe req-8de9830c-2932-47b7-b70d-22c66fe36cbf service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-vif-unplugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e6bcdbde-0af3-4d5c-a8dd-eb0443e2ffbe req-8de9830c-2932-47b7-b70d-22c66fe36cbf service nova] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e6bcdbde-0af3-4d5c-a8dd-eb0443e2ffbe req-8de9830c-2932-47b7-b70d-22c66fe36cbf service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e6bcdbde-0af3-4d5c-a8dd-eb0443e2ffbe req-8de9830c-2932-47b7-b70d-22c66fe36cbf service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-e6bcdbde-0af3-4d5c-a8dd-eb0443e2ffbe req-8de9830c-2932-47b7-b70d-22c66fe36cbf service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] No waiting events found dispatching network-vif-unplugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-e6bcdbde-0af3-4d5c-a8dd-eb0443e2ffbe req-8de9830c-2932-47b7-b70d-22c66fe36cbf service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-vif-unplugged-0318df0b-b216-408e-92a9-92ac03bb706c for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Instance destroyed successfully.
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'resources' on Instance uuid 734e86fe-b5c9-4c17-a360-fc7b7999b0bc {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-78868070',display_name='tempest-AttachVolumeNegativeTest-server-78868070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-78868070',id=22,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1QZfbh+6UifquvndrOMGMjvHQcAIi5pj+ghV9KS4eo/3ySJvZS5meYuvNfQdhBZa7D41JwEqYTFl/l4ALeFmGDVguTA9Ufh0CtA+6oMmP43hPRfwnB5LfLgH0DpinRVQ==',key_name='tempest-keypair-157203503',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-wbydw8kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=734e86fe-b5c9-4c17-a360-fc7b7999b0bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "0318df0b-b216-408e-92a9-92ac03bb706c", "address": "fa:16:3e:44:ac:fb", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0318df0b-b2", "ovs_interfaceid": "0318df0b-b216-408e-92a9-92ac03bb706c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:ac:fb,bridge_name='br-int',has_traffic_filtering=True,id=0318df0b-b216-408e-92a9-92ac03bb706c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318df0b-b2') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG os_vif [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:ac:fb,bridge_name='br-int',has_traffic_filtering=True,id=0318df0b-b216-408e-92a9-92ac03bb706c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318df0b-b2') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0318df0b-b2, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d645a7e-0fbb-45b5-99a0-08ac6b971f1e) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:35 user nova-compute[74534]: INFO os_vif [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:ac:fb,bridge_name='br-int',has_traffic_filtering=True,id=0318df0b-b216-408e-92a9-92ac03bb706c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0318df0b-b2')
Nov 02 12:15:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Deleting instance files /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc_del
Nov 02 12:15:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Deletion of /opt/stack/data/nova/instances/734e86fe-b5c9-4c17-a360-fc7b7999b0bc_del complete
Nov 02 12:15:35 user nova-compute[74534]: INFO nova.compute.manager [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 02 12:15:36 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:15:36 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Took 0.86 seconds to deallocate network for instance.
Nov 02 12:15:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:37 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Deleted allocations for instance 734e86fe-b5c9-4c17-a360-fc7b7999b0bc
Nov 02 12:15:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-9bc540a3-a3dd-478d-a556-8730d114cf19 req-8cbf9cab-19ec-47b3-ad79-581d76b909bc service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9bc540a3-a3dd-478d-a556-8730d114cf19 req-8cbf9cab-19ec-47b3-ad79-581d76b909bc service nova] Acquiring lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9bc540a3-a3dd-478d-a556-8730d114cf19 req-8cbf9cab-19ec-47b3-ad79-581d76b909bc service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9bc540a3-a3dd-478d-a556-8730d114cf19 req-8cbf9cab-19ec-47b3-ad79-581d76b909bc service nova] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-9bc540a3-a3dd-478d-a556-8730d114cf19 req-8cbf9cab-19ec-47b3-ad79-581d76b909bc service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] No waiting events found dispatching network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:37 user nova-compute[74534]: WARNING nova.compute.manager [req-9bc540a3-a3dd-478d-a556-8730d114cf19 req-8cbf9cab-19ec-47b3-ad79-581d76b909bc service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received unexpected event network-vif-plugged-0318df0b-b216-408e-92a9-92ac03bb706c for instance with vm_state deleted and task_state None.
Nov 02 12:15:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-9bc540a3-a3dd-478d-a556-8730d114cf19 req-8cbf9cab-19ec-47b3-ad79-581d76b909bc service nova] [instance: 734e86fe-b5c9-4c17-a360-fc7b7999b0bc] Received event network-vif-deleted-0318df0b-b216-408e-92a9-92ac03bb706c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-90d3647e-1023-4aaf-93b3-36056cb7a31a tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "734e86fe-b5c9-4c17-a360-fc7b7999b0bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:41 user nova-compute[74534]: INFO nova.compute.manager [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Terminating instance
Nov 02 12:15:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-f300b87f-ad26-4fbe-9b19-9fc57fc1a808 req-1bc4f582-5d6a-4021-ab40-7f6bfa545b9d service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-unplugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f300b87f-ad26-4fbe-9b19-9fc57fc1a808 req-1bc4f582-5d6a-4021-ab40-7f6bfa545b9d service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f300b87f-ad26-4fbe-9b19-9fc57fc1a808 req-1bc4f582-5d6a-4021-ab40-7f6bfa545b9d service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f300b87f-ad26-4fbe-9b19-9fc57fc1a808 req-1bc4f582-5d6a-4021-ab40-7f6bfa545b9d service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-f300b87f-ad26-4fbe-9b19-9fc57fc1a808 req-1bc4f582-5d6a-4021-ab40-7f6bfa545b9d service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-unplugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-f300b87f-ad26-4fbe-9b19-9fc57fc1a808 req-1bc4f582-5d6a-4021-ab40-7f6bfa545b9d service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-unplugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Instance destroyed successfully.
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lazy-loading 'resources' on Instance uuid a9159e85-6d12-4166-be94-8f8b1620761a {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1445971962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1718226071',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUvT97WEExqR0OQmGwpmELMt+ImPLb1+mXmovwHR4XLPFB0ez6vAOasZmSPO2WheLOO9pmkHuFYo38fre1rCWoG3U01qW0dS1//or12B5d7TtxG9aJO7yiW6xIGkwXZog==',key_name='tempest-keypair-1558372433',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:14:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d863bade99ab4f4e946637975a0f7224',ramdisk_id='',reservation_id='r-pec8wqms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1315298848',owner_user_name='tempest-ServerActionsV293TestJSON-1315298848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3db2c5117c754142978c7a872de22fb4',uuid=a9159e85-6d12-4166-be94-8f8b1620761a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converting VIF {"id": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "address": "fa:16:3e:31:93:02", "network": {"id": "06a48175-9484-4e29-a0f1-261abc3dd604", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-55193753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d863bade99ab4f4e946637975a0f7224", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3704c8b5-ec", "ovs_interfaceid": "3704c8b5-ecf1-441a-8c0e-9219f2e12835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_vif [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3704c8b5-ec, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ed14dbb-a6e8-46f0-9268-8ae23e0f97c8) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:42 user nova-compute[74534]: INFO os_vif [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:93:02,bridge_name='br-int',has_traffic_filtering=True,id=3704c8b5-ecf1-441a-8c0e-9219f2e12835,network=Network(06a48175-9484-4e29-a0f1-261abc3dd604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3704c8b5-ec')
Nov 02 12:15:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUWjdena', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:15:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b965e-c384-485f-ac58-058c54ba9f82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:15:42 user nova-compute[74534]: No targets found.
Nov 02 12:15:42 user nova-compute[74534]: iSNS:
Nov 02 12:15:42 user nova-compute[74534]: No targets found.
Nov 02 12:15:42 user nova-compute[74534]: STATIC:
Nov 02 12:15:42 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016
Nov 02 12:15:42 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:15:42 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:15:42 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:15:42 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:15:42 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:15:42 user nova-compute[74534]: FIRMWARE:
Nov 02 12:15:42 user nova-compute[74534]: No targets found.
Nov 02 12:15:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:15:42 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:15:42 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c480e97-db07-48b1-82b6-fb4cc56a8db5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c873f6e8-1f55-4488-b9f5-3b502750d6bd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:15:42 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:15:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:15:42 user nova-compute[74534]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 (non-flash)
Nov 02 12:15:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c5e5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dd7167-be12-4422-a1c9-2b0c71cf167f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a92bd1-13b1-4138-b6fe-09ede46207c9]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf73268d-515e-42ed-9fb1-46a303bc1006]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9e6007-0173-48df-b495-b46203920077]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4794fe17', '/dev/disk/by-id/scsi-1SCST_BIO4794fe17-5179435c51e8a5c3', '/dev/disk/by-id/scsi-23531373934333563') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe9e652-f175-4856-975b-d83c57c17b9b]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9129b-68eb-49ea-b378-47fecbbc2c57]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:15:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e63b0c-e9af-476c-aafd-b1db7b754ce8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260]
Nov 02 12:15:43 user nova-compute[74534]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016, portal: 172.16.0.220,3260] successful.
Nov 02 12:15:43 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23064b31-3e27-4c42-85d0-0cc2fe4ba016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d717d369-a6f9-48f9-a265-dff318cc30e8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] <== disconnect_volume: return (327ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:15:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Deleting instance files /opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a_del
Nov 02 12:15:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Deletion of /opt/stack/data/nova/instances/a9159e85-6d12-4166-be94-8f8b1620761a_del complete
Nov 02 12:15:43 user nova-compute[74534]: INFO nova.compute.manager [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 02 12:15:43 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:15:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:44 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:15:44 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Took 1.07 seconds to deallocate network for instance.
Nov 02 12:15:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-9216fbb4-be50-4507-a19d-420495172e7d req-2382e35b-db6e-4d63-9c6c-98d90fb83715 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-deleted-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-5c55cf26-a721-43d4-bbc8-34d86d8aa11d req-0eae092d-6d41-45ca-bb59-aa3fa7be6102 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:15:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c55cf26-a721-43d4-bbc8-34d86d8aa11d req-0eae092d-6d41-45ca-bb59-aa3fa7be6102 service nova] Acquiring lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c55cf26-a721-43d4-bbc8-34d86d8aa11d req-0eae092d-6d41-45ca-bb59-aa3fa7be6102 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5c55cf26-a721-43d4-bbc8-34d86d8aa11d req-0eae092d-6d41-45ca-bb59-aa3fa7be6102 service nova] Lock "a9159e85-6d12-4166-be94-8f8b1620761a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-5c55cf26-a721-43d4-bbc8-34d86d8aa11d req-0eae092d-6d41-45ca-bb59-aa3fa7be6102 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] No waiting events found dispatching network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:15:44 user nova-compute[74534]: WARNING nova.compute.manager [req-5c55cf26-a721-43d4-bbc8-34d86d8aa11d req-0eae092d-6d41-45ca-bb59-aa3fa7be6102 service nova] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Received unexpected event network-vif-plugged-3704c8b5-ecf1-441a-8c0e-9219f2e12835 for instance with vm_state active and task_state deleting.
Nov 02 12:15:45 user nova-compute[74534]: INFO nova.compute.manager [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Took 0.98 seconds to detach 1 volumes for instance.
Nov 02 12:15:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] [instance: a9159e85-6d12-4166-be94-8f8b1620761a] Deleting volume: 23064b31-3e27-4c42-85d0-0cc2fe4ba016 {{(pid=74534) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 12:15:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:45 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:15:45 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:15:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:45 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Deleted allocations for instance a9159e85-6d12-4166-be94-8f8b1620761a
Nov 02 12:15:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e94dedcf-7174-49bf-983f-6a78e0877400 tempest-ServerActionsV293TestJSON-1315298848 tempest-ServerActionsV293TestJSON-1315298848-project-member] Lock "a9159e85-6d12-4166-be94-8f8b1620761a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.880s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:15:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:15:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:15:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:15:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:15:55 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:15:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:15:58 user nova-compute[74534]: INFO nova.compute.claims [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Claim successful on node user
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.network.neutron [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:15:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.policy [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dae37e0cfa414111b89952d130d4fbf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c4b94f48eb458589f03332ebb35a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:15:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Creating image(s)
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "/opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "/opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "/opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk 1073741824" returned: 0 in 0.055s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG nova.network.neutron [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Successfully created port: 7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Cannot resize image /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Ensure instance console log exists: /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:15:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Successfully updated port: 7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "refresh_cache-90f3207f-f0b7-42b5-af22-3f07ecfd7425" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquired lock "refresh_cache-90f3207f-f0b7-42b5-af22-3f07ecfd7425" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received event network-changed-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Refreshing instance network info cache due to event network-changed-7a3633e2-d643-4fc8-a355-bb32629d66bb. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] Acquiring lock "refresh_cache-90f3207f-f0b7-42b5-af22-3f07ecfd7425" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Updating instance_info_cache with network_info: [{"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Releasing lock "refresh_cache-90f3207f-f0b7-42b5-af22-3f07ecfd7425" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Instance network_info: |[{"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] Acquired lock "refresh_cache-90f3207f-f0b7-42b5-af22-3f07ecfd7425" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.neutron [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Refreshing network info cache for port 7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Start _get_guest_xml network_info=[{"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:16:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2010208991',display_name='tempest-ServersNegativeTestJSON-server-2010208991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2010208991',id=27,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c4b94f48eb458589f03332ebb35a87',ramdisk_id='',reservation_id='r-y4quhs7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1439847488',owner_user_name='tempest-ServersNegativeTestJSON-1439847488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:15:59Z,user_data=None,user_id='dae37e0cfa414111b89952d130d4fbf2',uuid=90f3207f-f0b7-42b5-af22-3f07ecfd7425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converting VIF {"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=7a3633e2-d643-4fc8-a355-bb32629d66bb,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3633e2-d6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.objects.instance [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lazy-loading 'pci_devices' on Instance uuid 90f3207f-f0b7-42b5-af22-3f07ecfd7425 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:16:00 user nova-compute[74534]:   <uuid>90f3207f-f0b7-42b5-af22-3f07ecfd7425</uuid>
Nov 02 12:16:00 user nova-compute[74534]:   <name>instance-0000001b</name>
Nov 02 12:16:00 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:16:00 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:16:00 user nova-compute[74534]:   <metadata>
Nov 02 12:16:00 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:16:00 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:16:00 user nova-compute[74534]:       <nova:name>tempest-ServersNegativeTestJSON-server-2010208991</nova:name>
Nov 02 12:16:00 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:16:00</nova:creationTime>
Nov 02 12:16:00 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:16:00 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:16:00 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:16:00 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:16:00 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:16:00 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:16:00 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:16:00 user nova-compute[74534]:       <nova:owner>
Nov 02 12:16:00 user nova-compute[74534]:         <nova:user uuid="dae37e0cfa414111b89952d130d4fbf2">tempest-ServersNegativeTestJSON-1439847488-project-member</nova:user>
Nov 02 12:16:00 user nova-compute[74534]:         <nova:project uuid="38c4b94f48eb458589f03332ebb35a87">tempest-ServersNegativeTestJSON-1439847488</nova:project>
Nov 02 12:16:00 user nova-compute[74534]:       </nova:owner>
Nov 02 12:16:00 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:16:00 user nova-compute[74534]:       <nova:ports>
Nov 02 12:16:00 user nova-compute[74534]:         <nova:port uuid="7a3633e2-d643-4fc8-a355-bb32629d66bb">
Nov 02 12:16:00 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:16:00 user nova-compute[74534]:         </nova:port>
Nov 02 12:16:00 user nova-compute[74534]:       </nova:ports>
Nov 02 12:16:00 user nova-compute[74534]:     </nova:instance>
Nov 02 12:16:00 user nova-compute[74534]:   </metadata>
Nov 02 12:16:00 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:16:00 user nova-compute[74534]:     <system>
Nov 02 12:16:00 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:16:00 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:16:00 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:16:00 user nova-compute[74534]:       <entry name="serial">90f3207f-f0b7-42b5-af22-3f07ecfd7425</entry>
Nov 02 12:16:00 user nova-compute[74534]:       <entry name="uuid">90f3207f-f0b7-42b5-af22-3f07ecfd7425</entry>
Nov 02 12:16:00 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:16:00 user nova-compute[74534]:     </system>
Nov 02 12:16:00 user nova-compute[74534]:   </sysinfo>
Nov 02 12:16:00 user nova-compute[74534]:   <os>
Nov 02 12:16:00 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:16:00 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:16:00 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:16:00 user nova-compute[74534]:   </os>
Nov 02 12:16:00 user nova-compute[74534]:   <features>
Nov 02 12:16:00 user nova-compute[74534]:     <acpi/>
Nov 02 12:16:00 user nova-compute[74534]:     <apic/>
Nov 02 12:16:00 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:16:00 user nova-compute[74534]:   </features>
Nov 02 12:16:00 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:16:00 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:16:00 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:16:00 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:16:00 user nova-compute[74534]:   </clock>
Nov 02 12:16:00 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:16:00 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:16:00 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:16:00 user nova-compute[74534]:   </cpu>
Nov 02 12:16:00 user nova-compute[74534]:   <devices>
Nov 02 12:16:00 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:16:00 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:16:00 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk"/>
Nov 02 12:16:00 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:16:00 user nova-compute[74534]:     </disk>
Nov 02 12:16:00 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:16:00 user nova-compute[74534]:       <mac address="fa:16:3e:b5:91:ee"/>
Nov 02 12:16:00 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:00 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:16:00 user nova-compute[74534]:       <target dev="tap7a3633e2-d6"/>
Nov 02 12:16:00 user nova-compute[74534]:     </interface>
Nov 02 12:16:00 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:16:00 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/console.log" append="off"/>
Nov 02 12:16:00 user nova-compute[74534]:     </serial>
Nov 02 12:16:00 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:16:00 user nova-compute[74534]:     <video>
Nov 02 12:16:00 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:00 user nova-compute[74534]:     </video>
Nov 02 12:16:00 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:16:00 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:16:00 user nova-compute[74534]:     </rng>
Nov 02 12:16:00 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:16:00 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:16:00 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:16:00 user nova-compute[74534]:     </memballoon>
Nov 02 12:16:00 user nova-compute[74534]:   </devices>
Nov 02 12:16:00 user nova-compute[74534]: </domain>
Nov 02 12:16:00 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2010208991',display_name='tempest-ServersNegativeTestJSON-server-2010208991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2010208991',id=27,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38c4b94f48eb458589f03332ebb35a87',ramdisk_id='',reservation_id='r-y4quhs7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1439847488',owner_user_name='tempest-ServersNegativeTestJSON-1439847488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:15:59Z,user_data=None,user_id='dae37e0cfa414111b89952d130d4fbf2',uuid=90f3207f-f0b7-42b5-af22-3f07ecfd7425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converting VIF {"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=7a3633e2-d643-4fc8-a355-bb32629d66bb,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3633e2-d6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG os_vif [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=7a3633e2-d643-4fc8-a355-bb32629d66bb,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3633e2-d6') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4b605b1-af0c-5a46-bd0d-7ab54ebcb4de', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a3633e2-d6, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a3633e2-d6, col_values=(('qos', UUID('1bbc49b2-8155-408c-b0b5-605953fd1ff3')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a3633e2-d6, col_values=(('external_ids', {'iface-id': '7a3633e2-d643-4fc8-a355-bb32629d66bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:91:ee', 'vm-uuid': '90f3207f-f0b7-42b5-af22-3f07ecfd7425'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:00 user nova-compute[74534]: INFO os_vif [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=7a3633e2-d643-4fc8-a355-bb32629d66bb,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3633e2-d6')
Nov 02 12:16:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:16:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] No VIF found with MAC fa:16:3e:b5:91:ee, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:16:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Updated VIF entry in instance network info cache for port 7a3633e2-d643-4fc8-a355-bb32629d66bb. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:16:01 user nova-compute[74534]: DEBUG nova.network.neutron [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Updating instance_info_cache with network_info: [{"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-580665e4-7853-46eb-a76c-4b54ca78696d req-5deae971-0490-4210-896c-67a26047d304 service nova] Releasing lock "refresh_cache-90f3207f-f0b7-42b5-af22-3f07ecfd7425" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-3316a776-2d70-4756-9569-2b39712bf14a req-bbe0cd28-1e4a-47fb-b7e3-0db99ed587bd service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received event network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3316a776-2d70-4756-9569-2b39712bf14a req-bbe0cd28-1e4a-47fb-b7e3-0db99ed587bd service nova] Acquiring lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3316a776-2d70-4756-9569-2b39712bf14a req-bbe0cd28-1e4a-47fb-b7e3-0db99ed587bd service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3316a776-2d70-4756-9569-2b39712bf14a req-bbe0cd28-1e4a-47fb-b7e3-0db99ed587bd service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-3316a776-2d70-4756-9569-2b39712bf14a req-bbe0cd28-1e4a-47fb-b7e3-0db99ed587bd service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] No waiting events found dispatching network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:02 user nova-compute[74534]: WARNING nova.compute.manager [req-3316a776-2d70-4756-9569-2b39712bf14a req-bbe0cd28-1e4a-47fb-b7e3-0db99ed587bd service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received unexpected event network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb for instance with vm_state building and task_state spawning.
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating instance_info_cache with network_info: [{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:16:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:16:04 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Instance spawned successfully.
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-fa08c499-3415-4c0d-bdd9-099359de301b req-09285876-890d-492a-bb16-0612d1d9670c service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received event network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa08c499-3415-4c0d-bdd9-099359de301b req-09285876-890d-492a-bb16-0612d1d9670c service nova] Acquiring lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa08c499-3415-4c0d-bdd9-099359de301b req-09285876-890d-492a-bb16-0612d1d9670c service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fa08c499-3415-4c0d-bdd9-099359de301b req-09285876-890d-492a-bb16-0612d1d9670c service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-fa08c499-3415-4c0d-bdd9-099359de301b req-09285876-890d-492a-bb16-0612d1d9670c service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] No waiting events found dispatching network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:04 user nova-compute[74534]: WARNING nova.compute.manager [req-fa08c499-3415-4c0d-bdd9-099359de301b req-09285876-890d-492a-bb16-0612d1d9670c service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received unexpected event network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb for instance with vm_state building and task_state spawning.
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:04 user nova-compute[74534]: INFO nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 02 12:16:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:16:04 user nova-compute[74534]: INFO nova.compute.manager [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Took 6.73 seconds to build instance.
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-dcbc3311-2b63-4431-89c9-cd1955a795ac tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.861s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "d5330cc9-9437-4276-95f9-7b2909d0e49a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:05 user nova-compute[74534]: INFO nova.compute.manager [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Terminating instance
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-7c7cf2a6-2c6d-403c-aade-75d2f23712d1 req-6caf1f6c-43e2-466a-8575-a9c22d70448d service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received event network-vif-unplugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7c7cf2a6-2c6d-403c-aade-75d2f23712d1 req-6caf1f6c-43e2-466a-8575-a9c22d70448d service nova] Acquiring lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7c7cf2a6-2c6d-403c-aade-75d2f23712d1 req-6caf1f6c-43e2-466a-8575-a9c22d70448d service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7c7cf2a6-2c6d-403c-aade-75d2f23712d1 req-6caf1f6c-43e2-466a-8575-a9c22d70448d service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-7c7cf2a6-2c6d-403c-aade-75d2f23712d1 req-6caf1f6c-43e2-466a-8575-a9c22d70448d service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] No waiting events found dispatching network-vif-unplugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.compute.manager [req-7c7cf2a6-2c6d-403c-aade-75d2f23712d1 req-6caf1f6c-43e2-466a-8575-a9c22d70448d service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received event network-vif-unplugged-1dd20b02-2dd1-4399-859c-4aa0415c268f for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Instance destroyed successfully.
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.objects.instance [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lazy-loading 'resources' on Instance uuid d5330cc9-9437-4276-95f9-7b2909d0e49a {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-774729383',display_name='tempest-VolumesAdminNegativeTest-server-774729383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-774729383',id=24,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb39968885c2474e97da3a7e426c0e17',ramdisk_id='',reservation_id='r-erssyos8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1124753556',owner_user_name='tempest-VolumesAdminNegativeTest-1124753556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:14:06Z,user_data=None,user_id='2a71588ab6ed4d93aa359a76cbc9f7ac',uuid=d5330cc9-9437-4276-95f9-7b2909d0e49a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converting VIF {"id": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "address": "fa:16:3e:67:32:a5", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd20b02-2d", "ovs_interfaceid": "1dd20b02-2dd1-4399-859c-4aa0415c268f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:32:a5,bridge_name='br-int',has_traffic_filtering=True,id=1dd20b02-2dd1-4399-859c-4aa0415c268f,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd20b02-2d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG os_vif [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:32:a5,bridge_name='br-int',has_traffic_filtering=True,id=1dd20b02-2dd1-4399-859c-4aa0415c268f,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd20b02-2d') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dd20b02-2d, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fba8672-2a1a-422f-8e09-e420a49895fd) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:05 user nova-compute[74534]: INFO os_vif [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:32:a5,bridge_name='br-int',has_traffic_filtering=True,id=1dd20b02-2dd1-4399-859c-4aa0415c268f,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd20b02-2d')
Nov 02 12:16:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Deleting instance files /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a_del
Nov 02 12:16:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Deletion of /opt/stack/data/nova/instances/d5330cc9-9437-4276-95f9-7b2909d0e49a_del complete
Nov 02 12:16:06 user nova-compute[74534]: INFO nova.compute.manager [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:06 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Took 0.55 seconds to deallocate network for instance.
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.compute.manager [req-6eb20617-f15b-44ba-a59e-96501bb30507 req-afb69e9e-9fd7-4da7-afac-df4fd701821d service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received event network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6eb20617-f15b-44ba-a59e-96501bb30507 req-afb69e9e-9fd7-4da7-afac-df4fd701821d service nova] Acquiring lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6eb20617-f15b-44ba-a59e-96501bb30507 req-afb69e9e-9fd7-4da7-afac-df4fd701821d service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6eb20617-f15b-44ba-a59e-96501bb30507 req-afb69e9e-9fd7-4da7-afac-df4fd701821d service nova] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.compute.manager [req-6eb20617-f15b-44ba-a59e-96501bb30507 req-afb69e9e-9fd7-4da7-afac-df4fd701821d service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] No waiting events found dispatching network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:07 user nova-compute[74534]: WARNING nova.compute.manager [req-6eb20617-f15b-44ba-a59e-96501bb30507 req-afb69e9e-9fd7-4da7-afac-df4fd701821d service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received unexpected event network-vif-plugged-1dd20b02-2dd1-4399-859c-4aa0415c268f for instance with vm_state deleted and task_state None.
Nov 02 12:16:07 user nova-compute[74534]: DEBUG nova.compute.manager [req-6eb20617-f15b-44ba-a59e-96501bb30507 req-afb69e9e-9fd7-4da7-afac-df4fd701821d service nova] [instance: d5330cc9-9437-4276-95f9-7b2909d0e49a] Received event network-vif-deleted-1dd20b02-2dd1-4399-859c-4aa0415c268f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.984s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:07 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Deleted allocations for instance d5330cc9-9437-4276-95f9-7b2909d0e49a
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-67cfe17a-16e7-473e-aa8f-d22cb29c3a46 tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "d5330cc9-9437-4276-95f9-7b2909d0e49a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid 'd5330cc9-9437-4276-95f9-7b2909d0e49a' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd5330cc9-9437-4276-95f9-7b2909d0e49a' (instance-00000018)
Nov 02 12:16:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7583MB free_disk=25.097000122070312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90f3207f-f0b7-42b5-af22-3f07ecfd7425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:16:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:16:09 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:16:09 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:16:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:16:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:16:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:16:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 2 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:16:11 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Deletion of /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize failed
Nov 02 12:16:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:16:23 user nova-compute[74534]: INFO nova.compute.claims [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Claim successful on node user
Nov 02 12:16:23 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:16:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:16:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG nova.policy [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4eb3d0118fba4c4eb8edebcb7e68eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f40e1ed522748be85c5bdd3b6405652', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:16:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Creating image(s)
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "/opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "/opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "/opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.238s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.236s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk 1073741824" returned: 0 in 0.077s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Successfully created port: 3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Cannot resize image /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Ensure instance console log exists: /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Successfully updated port: 3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquired lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received event network-changed-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Refreshing instance network info cache due to event network-changed-3ce1e36c-386e-4249-8b97-dfc61c15ad5a. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] Acquiring lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updating instance_info_cache with network_info: [{"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Releasing lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Instance network_info: |[{"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] Acquired lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.neutron [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Refreshing network info cache for port 3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Start _get_guest_xml network_info=[{"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:16:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1955977745',display_name='tempest-AttachVolumeTestJSON-server-1955977745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1955977745',id=28,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE8TMUP1YXRO06BPy7geuZdEW2xWzEAqb2J4iiUysxqB5JGyMzpFoFydlV/xMoLzYwg/wvl84USouFusQS62Ahpu7ZxGJvyj9GEQkbAgxEEC+w2T+4RbNo9cW+gPdmRow==',key_name='tempest-keypair-170572953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-luikb13w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=868612a8-7a46-400e-add0-4eb7374ca056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:85:c5,bridge_name='br-int',has_traffic_filtering=True,id=3ce1e36c-386e-4249-8b97-dfc61c15ad5a,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce1e36c-38') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.objects.instance [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'pci_devices' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:16:26 user nova-compute[74534]:   <uuid>868612a8-7a46-400e-add0-4eb7374ca056</uuid>
Nov 02 12:16:26 user nova-compute[74534]:   <name>instance-0000001c</name>
Nov 02 12:16:26 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:16:26 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:16:26 user nova-compute[74534]:   <metadata>
Nov 02 12:16:26 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:16:26 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:16:26 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeTestJSON-server-1955977745</nova:name>
Nov 02 12:16:26 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:16:26</nova:creationTime>
Nov 02 12:16:26 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:16:26 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:16:26 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:16:26 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:16:26 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:16:26 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:16:26 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:16:26 user nova-compute[74534]:       <nova:owner>
Nov 02 12:16:26 user nova-compute[74534]:         <nova:user uuid="4eb3d0118fba4c4eb8edebcb7e68eb93">tempest-AttachVolumeTestJSON-1871374392-project-member</nova:user>
Nov 02 12:16:26 user nova-compute[74534]:         <nova:project uuid="6f40e1ed522748be85c5bdd3b6405652">tempest-AttachVolumeTestJSON-1871374392</nova:project>
Nov 02 12:16:26 user nova-compute[74534]:       </nova:owner>
Nov 02 12:16:26 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:16:26 user nova-compute[74534]:       <nova:ports>
Nov 02 12:16:26 user nova-compute[74534]:         <nova:port uuid="3ce1e36c-386e-4249-8b97-dfc61c15ad5a">
Nov 02 12:16:26 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 12:16:26 user nova-compute[74534]:         </nova:port>
Nov 02 12:16:26 user nova-compute[74534]:       </nova:ports>
Nov 02 12:16:26 user nova-compute[74534]:     </nova:instance>
Nov 02 12:16:26 user nova-compute[74534]:   </metadata>
Nov 02 12:16:26 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:16:26 user nova-compute[74534]:     <system>
Nov 02 12:16:26 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:16:26 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:16:26 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:16:26 user nova-compute[74534]:       <entry name="serial">868612a8-7a46-400e-add0-4eb7374ca056</entry>
Nov 02 12:16:26 user nova-compute[74534]:       <entry name="uuid">868612a8-7a46-400e-add0-4eb7374ca056</entry>
Nov 02 12:16:26 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:16:26 user nova-compute[74534]:     </system>
Nov 02 12:16:26 user nova-compute[74534]:   </sysinfo>
Nov 02 12:16:26 user nova-compute[74534]:   <os>
Nov 02 12:16:26 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:16:26 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:16:26 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:16:26 user nova-compute[74534]:   </os>
Nov 02 12:16:26 user nova-compute[74534]:   <features>
Nov 02 12:16:26 user nova-compute[74534]:     <acpi/>
Nov 02 12:16:26 user nova-compute[74534]:     <apic/>
Nov 02 12:16:26 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:16:26 user nova-compute[74534]:   </features>
Nov 02 12:16:26 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:16:26 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:16:26 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:16:26 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:16:26 user nova-compute[74534]:   </clock>
Nov 02 12:16:26 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:16:26 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:16:26 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:16:26 user nova-compute[74534]:   </cpu>
Nov 02 12:16:26 user nova-compute[74534]:   <devices>
Nov 02 12:16:26 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:16:26 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:16:26 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk"/>
Nov 02 12:16:26 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:16:26 user nova-compute[74534]:     </disk>
Nov 02 12:16:26 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:16:26 user nova-compute[74534]:       <mac address="fa:16:3e:70:85:c5"/>
Nov 02 12:16:26 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:26 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:16:26 user nova-compute[74534]:       <target dev="tap3ce1e36c-38"/>
Nov 02 12:16:26 user nova-compute[74534]:     </interface>
Nov 02 12:16:26 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:16:26 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/console.log" append="off"/>
Nov 02 12:16:26 user nova-compute[74534]:     </serial>
Nov 02 12:16:26 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:16:26 user nova-compute[74534]:     <video>
Nov 02 12:16:26 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:26 user nova-compute[74534]:     </video>
Nov 02 12:16:26 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:16:26 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:16:26 user nova-compute[74534]:     </rng>
Nov 02 12:16:26 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:16:26 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:16:26 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:16:26 user nova-compute[74534]:     </memballoon>
Nov 02 12:16:26 user nova-compute[74534]:   </devices>
Nov 02 12:16:26 user nova-compute[74534]: </domain>
Nov 02 12:16:26 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1955977745',display_name='tempest-AttachVolumeTestJSON-server-1955977745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1955977745',id=28,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE8TMUP1YXRO06BPy7geuZdEW2xWzEAqb2J4iiUysxqB5JGyMzpFoFydlV/xMoLzYwg/wvl84USouFusQS62Ahpu7ZxGJvyj9GEQkbAgxEEC+w2T+4RbNo9cW+gPdmRow==',key_name='tempest-keypair-170572953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-luikb13w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=868612a8-7a46-400e-add0-4eb7374ca056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:85:c5,bridge_name='br-int',has_traffic_filtering=True,id=3ce1e36c-386e-4249-8b97-dfc61c15ad5a,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce1e36c-38') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG os_vif [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:85:c5,bridge_name='br-int',has_traffic_filtering=True,id=3ce1e36c-386e-4249-8b97-dfc61c15ad5a,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce1e36c-38') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e247d091-c06d-52b3-b4af-cb4a90fbea80', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce1e36c-38, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ce1e36c-38, col_values=(('qos', UUID('69207a14-34a4-47c5-89bc-9102e91c90a9')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ce1e36c-38, col_values=(('external_ids', {'iface-id': '3ce1e36c-386e-4249-8b97-dfc61c15ad5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:85:c5', 'vm-uuid': '868612a8-7a46-400e-add0-4eb7374ca056'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:26 user nova-compute[74534]: INFO os_vif [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:85:c5,bridge_name='br-int',has_traffic_filtering=True,id=3ce1e36c-386e-4249-8b97-dfc61c15ad5a,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce1e36c-38')
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:16:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No VIF found with MAC fa:16:3e:70:85:c5, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:16:27 user nova-compute[74534]: DEBUG nova.network.neutron [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updated VIF entry in instance network info cache for port 3ce1e36c-386e-4249-8b97-dfc61c15ad5a. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:16:27 user nova-compute[74534]: DEBUG nova.network.neutron [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updating instance_info_cache with network_info: [{"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a5383378-b58e-47ae-a796-f8b44e3a60b0 req-6ee732d8-63ee-46a4-ba4d-77f3e0d892dc service nova] Releasing lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-7de69a30-49a1-49bb-8a14-a75236d8ebdf req-19f6f4eb-7a88-4c3f-8990-82e45da04c45 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received event network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7de69a30-49a1-49bb-8a14-a75236d8ebdf req-19f6f4eb-7a88-4c3f-8990-82e45da04c45 service nova] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7de69a30-49a1-49bb-8a14-a75236d8ebdf req-19f6f4eb-7a88-4c3f-8990-82e45da04c45 service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7de69a30-49a1-49bb-8a14-a75236d8ebdf req-19f6f4eb-7a88-4c3f-8990-82e45da04c45 service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-7de69a30-49a1-49bb-8a14-a75236d8ebdf req-19f6f4eb-7a88-4c3f-8990-82e45da04c45 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] No waiting events found dispatching network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:28 user nova-compute[74534]: WARNING nova.compute.manager [req-7de69a30-49a1-49bb-8a14-a75236d8ebdf req-19f6f4eb-7a88-4c3f-8990-82e45da04c45 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received unexpected event network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a for instance with vm_state building and task_state spawning.
Nov 02 12:16:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-c796153e-881a-4655-9216-c7db33488c9d req-9ea0e9ee-7936-43d3-b68d-580486ffce4a service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received event network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c796153e-881a-4655-9216-c7db33488c9d req-9ea0e9ee-7936-43d3-b68d-580486ffce4a service nova] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c796153e-881a-4655-9216-c7db33488c9d req-9ea0e9ee-7936-43d3-b68d-580486ffce4a service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c796153e-881a-4655-9216-c7db33488c9d req-9ea0e9ee-7936-43d3-b68d-580486ffce4a service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-c796153e-881a-4655-9216-c7db33488c9d req-9ea0e9ee-7936-43d3-b68d-580486ffce4a service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] No waiting events found dispatching network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:31 user nova-compute[74534]: WARNING nova.compute.manager [req-c796153e-881a-4655-9216-c7db33488c9d req-9ea0e9ee-7936-43d3-b68d-580486ffce4a service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received unexpected event network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a for instance with vm_state building and task_state spawning.
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:16:31 user nova-compute[74534]: INFO nova.compute.claims [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Claim successful on node user
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:16:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Instance spawned successfully.
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:31 user nova-compute[74534]: INFO nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:16:31 user nova-compute[74534]: INFO nova.compute.manager [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Took 8.11 seconds to build instance.
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-51fa660b-98c6-4bb2-b5df-170b1fb6177b tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.224s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.089s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:16:31 user nova-compute[74534]: INFO nova.compute.claims [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Claim successful on node user
Nov 02 12:16:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:16:31 user nova-compute[74534]: DEBUG nova.network.neutron [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:16:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:16:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG nova.policy [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cb6a67fcb13459880727c825793db65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcb68ce88ae4280ba6feb308b7c53da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:16:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Creating image(s)
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "/opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "/opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.227s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.253s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.252s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk 1073741824" returned: 0 in 0.080s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:16:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:16:33 user nova-compute[74534]: INFO nova.virt.block_device [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Booting with volume-backed-image 36642543-2106-4841-8acf-2e35b58c4209 at /dev/vda
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.257s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.policy [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'caf5cde0e75e444da00c7bcda4bcdd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ccb20fcd184ecebd3707d9d93c8817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Successfully created port: 6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Cannot resize image /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Ensure instance console log exists: /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Successfully created port: dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:16:34 user nova-compute[74534]: INFO nova.compute.manager [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Rescuing
Nov 02 12:16:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:16:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Successfully updated port: 6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:16:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquired lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:16:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-changed-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Refreshing instance network info cache due to event network-changed-6d2cb6a4-7508-4329-9906-e16f5e08123c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:16:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] Acquiring lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.network.neutron [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.network.neutron [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updating instance_info_cache with network_info: [{"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Releasing lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Instance network_info: |[{"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] Acquired lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.network.neutron [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Refreshing network info cache for port 6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Start _get_guest_xml network_info=[{"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:16:36 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:36 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1401385634',display_name='tempest-AttachVolumeNegativeTest-server-1401385634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1401385634',id=29,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjMRyZgfu5uLcDn2l4+DR7SMj71ig4QWsjh7m6fMun3vPyPEupriY0q1Kep+sdM3RyT8NgDL2P7tuFJkF+HKJviGGaJlvzqBjPRMjvSfi2abVC9Uoif5KcGBbW0UFjMYg==',key_name='tempest-keypair-102699055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-op7f51fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=af8aed6f-de40-47e9-a777-0122aac6e29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c6:82,bridge_name='br-int',has_traffic_filtering=True,id=6d2cb6a4-7508-4329-9906-e16f5e08123c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2cb6a4-75') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.objects.instance [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'pci_devices' on Instance uuid af8aed6f-de40-47e9-a777-0122aac6e29c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:16:36 user nova-compute[74534]:   <uuid>af8aed6f-de40-47e9-a777-0122aac6e29c</uuid>
Nov 02 12:16:36 user nova-compute[74534]:   <name>instance-0000001d</name>
Nov 02 12:16:36 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:16:36 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:16:36 user nova-compute[74534]:   <metadata>
Nov 02 12:16:36 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:16:36 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:16:36 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1401385634</nova:name>
Nov 02 12:16:36 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:16:36</nova:creationTime>
Nov 02 12:16:36 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:16:36 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:16:36 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:16:36 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:16:36 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:16:36 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:16:36 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:16:36 user nova-compute[74534]:       <nova:owner>
Nov 02 12:16:36 user nova-compute[74534]:         <nova:user uuid="3cb6a67fcb13459880727c825793db65">tempest-AttachVolumeNegativeTest-322425016-project-member</nova:user>
Nov 02 12:16:36 user nova-compute[74534]:         <nova:project uuid="8fcb68ce88ae4280ba6feb308b7c53da">tempest-AttachVolumeNegativeTest-322425016</nova:project>
Nov 02 12:16:36 user nova-compute[74534]:       </nova:owner>
Nov 02 12:16:36 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:16:36 user nova-compute[74534]:       <nova:ports>
Nov 02 12:16:36 user nova-compute[74534]:         <nova:port uuid="6d2cb6a4-7508-4329-9906-e16f5e08123c">
Nov 02 12:16:36 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:16:36 user nova-compute[74534]:         </nova:port>
Nov 02 12:16:36 user nova-compute[74534]:       </nova:ports>
Nov 02 12:16:36 user nova-compute[74534]:     </nova:instance>
Nov 02 12:16:36 user nova-compute[74534]:   </metadata>
Nov 02 12:16:36 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:16:36 user nova-compute[74534]:     <system>
Nov 02 12:16:36 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:16:36 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:16:36 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:16:36 user nova-compute[74534]:       <entry name="serial">af8aed6f-de40-47e9-a777-0122aac6e29c</entry>
Nov 02 12:16:36 user nova-compute[74534]:       <entry name="uuid">af8aed6f-de40-47e9-a777-0122aac6e29c</entry>
Nov 02 12:16:36 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:16:36 user nova-compute[74534]:     </system>
Nov 02 12:16:36 user nova-compute[74534]:   </sysinfo>
Nov 02 12:16:36 user nova-compute[74534]:   <os>
Nov 02 12:16:36 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:16:36 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:16:36 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:16:36 user nova-compute[74534]:   </os>
Nov 02 12:16:36 user nova-compute[74534]:   <features>
Nov 02 12:16:36 user nova-compute[74534]:     <acpi/>
Nov 02 12:16:36 user nova-compute[74534]:     <apic/>
Nov 02 12:16:36 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:16:36 user nova-compute[74534]:   </features>
Nov 02 12:16:36 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:16:36 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:16:36 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:16:36 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:16:36 user nova-compute[74534]:   </clock>
Nov 02 12:16:36 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:16:36 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:16:36 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:16:36 user nova-compute[74534]:   </cpu>
Nov 02 12:16:36 user nova-compute[74534]:   <devices>
Nov 02 12:16:36 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:16:36 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:16:36 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk"/>
Nov 02 12:16:36 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:16:36 user nova-compute[74534]:     </disk>
Nov 02 12:16:36 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:16:36 user nova-compute[74534]:       <mac address="fa:16:3e:c5:c6:82"/>
Nov 02 12:16:36 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:36 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:16:36 user nova-compute[74534]:       <target dev="tap6d2cb6a4-75"/>
Nov 02 12:16:36 user nova-compute[74534]:     </interface>
Nov 02 12:16:36 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:16:36 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/console.log" append="off"/>
Nov 02 12:16:36 user nova-compute[74534]:     </serial>
Nov 02 12:16:36 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:16:36 user nova-compute[74534]:     <video>
Nov 02 12:16:36 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:36 user nova-compute[74534]:     </video>
Nov 02 12:16:36 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:16:36 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:16:36 user nova-compute[74534]:     </rng>
Nov 02 12:16:36 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:16:36 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:16:36 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:16:36 user nova-compute[74534]:     </memballoon>
Nov 02 12:16:36 user nova-compute[74534]:   </devices>
Nov 02 12:16:36 user nova-compute[74534]: </domain>
Nov 02 12:16:36 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1401385634',display_name='tempest-AttachVolumeNegativeTest-server-1401385634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1401385634',id=29,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjMRyZgfu5uLcDn2l4+DR7SMj71ig4QWsjh7m6fMun3vPyPEupriY0q1Kep+sdM3RyT8NgDL2P7tuFJkF+HKJviGGaJlvzqBjPRMjvSfi2abVC9Uoif5KcGBbW0UFjMYg==',key_name='tempest-keypair-102699055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-op7f51fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=af8aed6f-de40-47e9-a777-0122aac6e29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c6:82,bridge_name='br-int',has_traffic_filtering=True,id=6d2cb6a4-7508-4329-9906-e16f5e08123c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2cb6a4-75') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG os_vif [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c6:82,bridge_name='br-int',has_traffic_filtering=True,id=6d2cb6a4-7508-4329-9906-e16f5e08123c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2cb6a4-75') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53d7d1b4-6b01-538f-bc8e-bc45aa75011c', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d2cb6a4-75, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d2cb6a4-75, col_values=(('qos', UUID('a7a88ff7-1510-4a37-85a0-b2029cd67d5a')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d2cb6a4-75, col_values=(('external_ids', {'iface-id': '6d2cb6a4-7508-4329-9906-e16f5e08123c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:c6:82', 'vm-uuid': 'af8aed6f-de40-47e9-a777-0122aac6e29c'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: INFO os_vif [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:c6:82,bridge_name='br-int',has_traffic_filtering=True,id=6d2cb6a4-7508-4329-9906-e16f5e08123c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2cb6a4-75')
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:16:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No VIF found with MAC fa:16:3e:c5:c6:82, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Successfully updated port: dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-changed-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Refreshing instance network info cache due to event network-changed-dc473798-99ef-4267-9840-e445a25d7322. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] Acquiring lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.network.neutron [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updated VIF entry in instance network info cache for port 6d2cb6a4-7508-4329-9906-e16f5e08123c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.network.neutron [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updating instance_info_cache with network_info: [{"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8d0d58fe-0ce4-4892-b243-3876d2a9d67b req-4b9fe780-406b-40a1-9c22-bdbce52ef4cc service nova] Releasing lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updating instance_info_cache with network_info: [{"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance network_info: |[{"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] Acquired lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:37 user nova-compute[74534]: DEBUG nova.network.neutron [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Refreshing network info cache for port dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:16:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance destroyed successfully.
Nov 02 12:16:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Attempting rescue
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74534) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance directory exists: not creating {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 12:16:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Creating image(s)
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.network.neutron [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updated VIF entry in instance network info cache for port dc473798-99ef-4267-9840-e445a25d7322. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.network.neutron [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updating instance_info_cache with network_info: [{"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fec9e631-15c8-4ddd-9081-b2a4be02b8b8 req-2bbaf279-362f-4396-a005-e7cb3e97e4f2 service nova] Releasing lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue" returned: 0 in 0.057s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'migration_context' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<90d26a35-e2a4-4f31-bc84-579e2ab28798> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Start _get_guest_xml network_info=[{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:0c:a6:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36642543-2106-4841-8acf-2e35b58c4209', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'resources' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<90d26a35-e2a4-4f31-bc84-579e2ab28798> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'numa_topology' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<90d26a35-e2a4-4f31-bc84-579e2ab28798> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:16:38 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:38 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:16:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<90d26a35-e2a4-4f31-bc84-579e2ab28798> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-771521797',display_name='tempest-ServerRescueNegativeTestJSON-server-771521797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-771521797',id=20,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:11:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-i1b2l74y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:11:55Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=90d26a35-e2a4-4f31-bc84-579e2ab28798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:0c:a6:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:0c:a6:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'pci_devices' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.objects.base [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<90d26a35-e2a4-4f31-bc84-579e2ab28798> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:16:38 user nova-compute[74534]:   <uuid>90d26a35-e2a4-4f31-bc84-579e2ab28798</uuid>
Nov 02 12:16:38 user nova-compute[74534]:   <name>instance-00000014</name>
Nov 02 12:16:38 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:16:38 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:16:38 user nova-compute[74534]:   <metadata>
Nov 02 12:16:38 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:16:38 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:16:38 user nova-compute[74534]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-771521797</nova:name>
Nov 02 12:16:38 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:16:38</nova:creationTime>
Nov 02 12:16:38 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:16:38 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:16:38 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:16:38 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:16:38 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:16:38 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:16:38 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:16:38 user nova-compute[74534]:       <nova:owner>
Nov 02 12:16:38 user nova-compute[74534]:         <nova:user uuid="c0dabe5e283645a382a1f0bf6ab7ddf1">tempest-ServerRescueNegativeTestJSON-158551613-project-member</nova:user>
Nov 02 12:16:38 user nova-compute[74534]:         <nova:project uuid="294df1c916c248d496812d8b2bb1b57e">tempest-ServerRescueNegativeTestJSON-158551613</nova:project>
Nov 02 12:16:38 user nova-compute[74534]:       </nova:owner>
Nov 02 12:16:38 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:16:38 user nova-compute[74534]:       <nova:ports>
Nov 02 12:16:38 user nova-compute[74534]:         <nova:port uuid="0ac87943-5280-44ef-9afa-523d2b996e19">
Nov 02 12:16:38 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 12:16:38 user nova-compute[74534]:         </nova:port>
Nov 02 12:16:38 user nova-compute[74534]:       </nova:ports>
Nov 02 12:16:38 user nova-compute[74534]:     </nova:instance>
Nov 02 12:16:38 user nova-compute[74534]:   </metadata>
Nov 02 12:16:38 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:16:38 user nova-compute[74534]:     <system>
Nov 02 12:16:38 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:16:38 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:16:38 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:16:38 user nova-compute[74534]:       <entry name="serial">90d26a35-e2a4-4f31-bc84-579e2ab28798</entry>
Nov 02 12:16:38 user nova-compute[74534]:       <entry name="uuid">90d26a35-e2a4-4f31-bc84-579e2ab28798</entry>
Nov 02 12:16:38 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:16:38 user nova-compute[74534]:     </system>
Nov 02 12:16:38 user nova-compute[74534]:   </sysinfo>
Nov 02 12:16:38 user nova-compute[74534]:   <os>
Nov 02 12:16:38 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:16:38 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:16:38 user nova-compute[74534]:   </os>
Nov 02 12:16:38 user nova-compute[74534]:   <features>
Nov 02 12:16:38 user nova-compute[74534]:     <acpi/>
Nov 02 12:16:38 user nova-compute[74534]:     <apic/>
Nov 02 12:16:38 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:16:38 user nova-compute[74534]:   </features>
Nov 02 12:16:38 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:16:38 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:16:38 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:16:38 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:16:38 user nova-compute[74534]:   </clock>
Nov 02 12:16:38 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:16:38 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:16:38 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:16:38 user nova-compute[74534]:   </cpu>
Nov 02 12:16:38 user nova-compute[74534]:   <devices>
Nov 02 12:16:38 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:16:38 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:16:38 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue"/>
Nov 02 12:16:38 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:16:38 user nova-compute[74534]:     </disk>
Nov 02 12:16:38 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:16:38 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:16:38 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk"/>
Nov 02 12:16:38 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:16:38 user nova-compute[74534]:     </disk>
Nov 02 12:16:38 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:16:38 user nova-compute[74534]:       <mac address="fa:16:3e:0c:a6:a3"/>
Nov 02 12:16:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:38 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:16:38 user nova-compute[74534]:       <target dev="tap0ac87943-52"/>
Nov 02 12:16:38 user nova-compute[74534]:     </interface>
Nov 02 12:16:38 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:16:38 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/console.log" append="off"/>
Nov 02 12:16:38 user nova-compute[74534]:     </serial>
Nov 02 12:16:38 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:16:38 user nova-compute[74534]:     <video>
Nov 02 12:16:38 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:16:38 user nova-compute[74534]:     </video>
Nov 02 12:16:38 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:16:38 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:16:38 user nova-compute[74534]:     </rng>
Nov 02 12:16:38 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:16:38 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:16:38 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:16:38 user nova-compute[74534]:     </memballoon>
Nov 02 12:16:38 user nova-compute[74534]:   </devices>
Nov 02 12:16:38 user nova-compute[74534]: </domain>
Nov 02 12:16:38 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:16:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance destroyed successfully.
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:16:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No VIF found with MAC fa:16:3e:0c:a6:a3, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-7d571238-daf6-45d6-96a6-522e05de66f5 req-e619207e-c015-42dc-9af4-2b1a0709e4d9 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7d571238-daf6-45d6-96a6-522e05de66f5 req-e619207e-c015-42dc-9af4-2b1a0709e4d9 service nova] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7d571238-daf6-45d6-96a6-522e05de66f5 req-e619207e-c015-42dc-9af4-2b1a0709e4d9 service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7d571238-daf6-45d6-96a6-522e05de66f5 req-e619207e-c015-42dc-9af4-2b1a0709e4d9 service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-7d571238-daf6-45d6-96a6-522e05de66f5 req-e619207e-c015-42dc-9af4-2b1a0709e4d9 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] No waiting events found dispatching network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:39 user nova-compute[74534]: WARNING nova.compute.manager [req-7d571238-daf6-45d6-96a6-522e05de66f5 req-e619207e-c015-42dc-9af4-2b1a0709e4d9 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received unexpected event network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c for instance with vm_state building and task_state spawning.
Nov 02 12:16:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:39 user nova-compute[74534]: WARNING nova.compute.manager [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state active and task_state rescuing.
Nov 02 12:16:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:39 user nova-compute[74534]: WARNING nova.compute.manager [req-fbd1c6b6-6fbf-43f7-8556-f8eb1d6a1a72 req-b1bacae7-04ba-4303-b5b5-0d060199711f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state active and task_state rescuing.
Nov 02 12:16:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-13bb68a3-7bf1-4a37-9281-2457383681a1 req-4377ce09-9abd-4e87-af4a-29de2ddcd924 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-13bb68a3-7bf1-4a37-9281-2457383681a1 req-4377ce09-9abd-4e87-af4a-29de2ddcd924 service nova] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-13bb68a3-7bf1-4a37-9281-2457383681a1 req-4377ce09-9abd-4e87-af4a-29de2ddcd924 service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-13bb68a3-7bf1-4a37-9281-2457383681a1 req-4377ce09-9abd-4e87-af4a-29de2ddcd924 service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-13bb68a3-7bf1-4a37-9281-2457383681a1 req-4377ce09-9abd-4e87-af4a-29de2ddcd924 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] No waiting events found dispatching network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:41 user nova-compute[74534]: WARNING nova.compute.manager [req-13bb68a3-7bf1-4a37-9281-2457383681a1 req-4377ce09-9abd-4e87-af4a-29de2ddcd924 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received unexpected event network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c for instance with vm_state building and task_state spawning.
Nov 02 12:16:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-2cccce37-6755-4923-9067-ef28c37899c0 req-c4566f75-880c-4803-a1ea-d8cb592de6d7 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2cccce37-6755-4923-9067-ef28c37899c0 req-c4566f75-880c-4803-a1ea-d8cb592de6d7 service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2cccce37-6755-4923-9067-ef28c37899c0 req-c4566f75-880c-4803-a1ea-d8cb592de6d7 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2cccce37-6755-4923-9067-ef28c37899c0 req-c4566f75-880c-4803-a1ea-d8cb592de6d7 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:41 user nova-compute[74534]: DEBUG nova.compute.manager [req-2cccce37-6755-4923-9067-ef28c37899c0 req-c4566f75-880c-4803-a1ea-d8cb592de6d7 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:41 user nova-compute[74534]: WARNING nova.compute.manager [req-2cccce37-6755-4923-9067-ef28c37899c0 req-c4566f75-880c-4803-a1ea-d8cb592de6d7 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state active and task_state rescuing.
Nov 02 12:16:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:16:42 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Instance spawned successfully.
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:16:42 user nova-compute[74534]: INFO nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Took 10.29 seconds to spawn the instance on the hypervisor.
Nov 02 12:16:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:16:42 user nova-compute[74534]: INFO nova.compute.manager [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Took 11.96 seconds to build instance.
Nov 02 12:16:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-502032ea-ff19-4dd3-82b9-2ecfd3320310 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.101s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-35c6b3b1-d1f2-4f49-80c4-3d798c1b3921 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:16:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-1784560d-37d8-488b-abb6-eac5c54234dd req-189ec450-2f3f-41ee-8c85-7577740f5901 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1784560d-37d8-488b-abb6-eac5c54234dd req-189ec450-2f3f-41ee-8c85-7577740f5901 service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1784560d-37d8-488b-abb6-eac5c54234dd req-189ec450-2f3f-41ee-8c85-7577740f5901 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1784560d-37d8-488b-abb6-eac5c54234dd req-189ec450-2f3f-41ee-8c85-7577740f5901 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-1784560d-37d8-488b-abb6-eac5c54234dd req-189ec450-2f3f-41ee-8c85-7577740f5901 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:16:43 user nova-compute[74534]: WARNING nova.compute.manager [req-1784560d-37d8-488b-abb6-eac5c54234dd req-189ec450-2f3f-41ee-8c85-7577740f5901 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state active and task_state rescuing.
Nov 02 12:16:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-changed-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Refreshing instance network info cache due to event network-changed-57ec1a30-0005-4023-9cf9-1fe8a034a53e. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] Acquiring lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] Acquired lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Refreshing network info cache for port 57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updated VIF entry in instance network info cache for port 57ec1a30-0005-4023-9cf9-1fe8a034a53e. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updating instance_info_cache with network_info: [{"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:16:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-870d5c85-6560-4c59-83d6-75710ee7cc30 req-84e5fd46-642f-4d24-83f0-775747839769 service nova] Releasing lock "refresh_cache-75b42e29-aba9-462e-bfe8-a9075c7c10ff" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG nova.objects.instance [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'flavor' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:16:49 user nova-compute[74534]: INFO nova.compute.manager [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Attaching volume 38b35512-2c64-41f8-b40a-0f9bc049ae2f to /dev/vdb
Nov 02 12:16:49 user nova-compute[74534]: DEBUG os_brick.utils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffb14f-5205-4ac5-896c-f1c5e0c5bdf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab14fb6-5eea-4d46-a643-a59ef94bec7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc057042-a1d2-4750-9bf1-3bdff58fb439]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c1693-c870-4e71-9a41-d12f236dc75e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:16:49 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:16:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fdca52-23f7-4ed7-802e-2b57e1334e80]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG os_brick.utils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:16:49 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updating existing volume attachment record: 1b5d3e0c-0abb-4945-8536-4be3e3b52a38 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:16:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG os_brick.utils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389ab6d-4a1d-4b3f-a0ea-2f842c8a5831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dc2bfb-658b-4f5b-bd9c-1abd99223a0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a9f5f7-407e-4168-bc13-699affb9ed5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7ead19-0982-4833-bb51-34aa89151863]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:16:54 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:16:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d66a5-74d7-4c73-8791-152bcdbaf95e]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG os_brick.utils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== get_connector_properties: return (200ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:16:54 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updating existing volume attachment record: e9e4ead8-742e-4943-98e3-5e1b87213420 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:16:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:16:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:16:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:02 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:17:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:17:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:17:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:17:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updating instance_info_cache with network_info: [{"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-e20af21c-b63b-4fd2-b4f3-8ca800894ea9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:05 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:17:05 user nova-compute[74534]: INFO nova.compute.claims [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Claim successful on node user
Nov 02 12:17:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.995s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:17:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:17:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: INFO nova.virt.block_device [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Booting with volume 2984cf70-c44e-4474-863c-ea3f87f96db1 at /dev/vda
Nov 02 12:17:07 user nova-compute[74534]: DEBUG nova.policy [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec72fd62d437457ba42756f1da97516c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f787c9b1e8154b4da75ac5299c888706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG os_brick.utils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb25fb-a0c5-4b9e-9729-d037b1b668d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aac0834-3e39-4059-86b7-1d12de535097]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c293ce4-c18f-4400-bdec-d52baa7fb367]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b82b2ab-d12b-4d62-8f46-e448d3da2bb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:17:07 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e7831e-098f-402d-9b5a-6fa513a76ad2]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG os_brick.utils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating existing volume attachment record: daae7c69-e5ee-48ea-88cd-9667d8014d6d {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Successfully created port: 9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:17:08 user nova-compute[74534]: INFO nova.compute.claims [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Claim successful on node user
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Successfully updated port: 9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquired lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.manager [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-changed-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.manager [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Refreshing instance network info cache due to event network-changed-9ce301a6-44ca-4ef0-81ce-3fa446504903. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] Acquiring lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.849s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating instance_info_cache with network_info: [{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Releasing lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance network_info: |[{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] Acquired lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.network.neutron [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Refreshing network info cache for port 9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:17:09 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.policy [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e713bb115ec8416ab1f2a51a93051233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cc76741e7745b5a49b4c7ee2a8c441', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:17:09 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Creating image(s)
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "/opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "/opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "/opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.234s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updated VIF entry in instance network info cache for port 9ce301a6-44ca-4ef0-81ce-3fa446504903. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating instance_info_cache with network_info: [{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ddfea56e-83fd-48d5-bf5d-41d720d76937 req-b10c2964-53f9-4fe7-821c-87f900565f01 service nova] Releasing lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk 1073741824" returned: 0 in 0.109s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Successfully created port: b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Cannot resize image /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Ensure instance console log exists: /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Successfully updated port: b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received event network-changed-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Refreshing instance network info cache due to event network-changed-b5750788-98de-44ce-9e0d-5aabea596de0. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] Acquiring lock "refresh_cache-851d34d6-c9f0-4db3-8e3b-5e31eba77479" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] Acquired lock "refresh_cache-851d34d6-c9f0-4db3-8e3b-5e31eba77479" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Refreshing network info cache for port b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "refresh_cache-851d34d6-c9f0-4db3-8e3b-5e31eba77479" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7257MB free_disk=25.018306732177734GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f49f8a0e-4cde-4ef7-b61c-ea307d34fd27 req-77443a97-fae4-44cf-bf2d-7d2b815dad32 service nova] Releasing lock "refresh_cache-851d34d6-c9f0-4db3-8e3b-5e31eba77479" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquired lock "refresh_cache-851d34d6-c9f0-4db3-8e3b-5e31eba77479" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90f3207f-f0b7-42b5-af22-3f07ecfd7425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 868612a8-7a46-400e-add0-4eb7374ca056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance af8aed6f-de40-47e9-a777-0122aac6e29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 851d34d6-c9f0-4db3-8e3b-5e31eba77479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Updating instance_info_cache with network_info: [{"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Releasing lock "refresh_cache-851d34d6-c9f0-4db3-8e3b-5e31eba77479" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Instance network_info: |[{"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Start _get_guest_xml network_info=[{"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:17:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-954059505',display_name='tempest-VolumesActionsTest-instance-954059505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-954059505',id=32,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cc76741e7745b5a49b4c7ee2a8c441',ramdisk_id='',reservation_id='r-15pvwz2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1016251624',owner_user_name='tempest-VolumesActionsTest-1016251624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:17:10Z,user_data=None,user_id='e713bb115ec8416ab1f2a51a93051233',uuid=851d34d6-c9f0-4db3-8e3b-5e31eba77479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Converting VIF {"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:89,bridge_name='br-int',has_traffic_filtering=True,id=b5750788-98de-44ce-9e0d-5aabea596de0,network=Network(301a023c-87d9-4d23-bd67-019e4de327b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5750788-98') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lazy-loading 'pci_devices' on Instance uuid 851d34d6-c9f0-4db3-8e3b-5e31eba77479 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:17:12 user nova-compute[74534]:   <uuid>851d34d6-c9f0-4db3-8e3b-5e31eba77479</uuid>
Nov 02 12:17:12 user nova-compute[74534]:   <name>instance-00000020</name>
Nov 02 12:17:12 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:17:12 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:17:12 user nova-compute[74534]:   <metadata>
Nov 02 12:17:12 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:17:12 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:17:12 user nova-compute[74534]:       <nova:name>tempest-VolumesActionsTest-instance-954059505</nova:name>
Nov 02 12:17:12 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:17:12</nova:creationTime>
Nov 02 12:17:12 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:17:12 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:17:12 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:17:12 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:17:12 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:17:12 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:17:12 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:17:12 user nova-compute[74534]:       <nova:owner>
Nov 02 12:17:12 user nova-compute[74534]:         <nova:user uuid="e713bb115ec8416ab1f2a51a93051233">tempest-VolumesActionsTest-1016251624-project-member</nova:user>
Nov 02 12:17:12 user nova-compute[74534]:         <nova:project uuid="42cc76741e7745b5a49b4c7ee2a8c441">tempest-VolumesActionsTest-1016251624</nova:project>
Nov 02 12:17:12 user nova-compute[74534]:       </nova:owner>
Nov 02 12:17:12 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:17:12 user nova-compute[74534]:       <nova:ports>
Nov 02 12:17:12 user nova-compute[74534]:         <nova:port uuid="b5750788-98de-44ce-9e0d-5aabea596de0">
Nov 02 12:17:12 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 12:17:12 user nova-compute[74534]:         </nova:port>
Nov 02 12:17:12 user nova-compute[74534]:       </nova:ports>
Nov 02 12:17:12 user nova-compute[74534]:     </nova:instance>
Nov 02 12:17:12 user nova-compute[74534]:   </metadata>
Nov 02 12:17:12 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:17:12 user nova-compute[74534]:     <system>
Nov 02 12:17:12 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:17:12 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:17:12 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:17:12 user nova-compute[74534]:       <entry name="serial">851d34d6-c9f0-4db3-8e3b-5e31eba77479</entry>
Nov 02 12:17:12 user nova-compute[74534]:       <entry name="uuid">851d34d6-c9f0-4db3-8e3b-5e31eba77479</entry>
Nov 02 12:17:12 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:17:12 user nova-compute[74534]:     </system>
Nov 02 12:17:12 user nova-compute[74534]:   </sysinfo>
Nov 02 12:17:12 user nova-compute[74534]:   <os>
Nov 02 12:17:12 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:17:12 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:17:12 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:17:12 user nova-compute[74534]:   </os>
Nov 02 12:17:12 user nova-compute[74534]:   <features>
Nov 02 12:17:12 user nova-compute[74534]:     <acpi/>
Nov 02 12:17:12 user nova-compute[74534]:     <apic/>
Nov 02 12:17:12 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:17:12 user nova-compute[74534]:   </features>
Nov 02 12:17:12 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:17:12 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:17:12 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:17:12 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:17:12 user nova-compute[74534]:   </clock>
Nov 02 12:17:12 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:17:12 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:17:12 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:17:12 user nova-compute[74534]:   </cpu>
Nov 02 12:17:12 user nova-compute[74534]:   <devices>
Nov 02 12:17:12 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:17:12 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:17:12 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk"/>
Nov 02 12:17:12 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:17:12 user nova-compute[74534]:     </disk>
Nov 02 12:17:12 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:17:12 user nova-compute[74534]:       <mac address="fa:16:3e:ca:ed:89"/>
Nov 02 12:17:12 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:17:12 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:17:12 user nova-compute[74534]:       <target dev="tapb5750788-98"/>
Nov 02 12:17:12 user nova-compute[74534]:     </interface>
Nov 02 12:17:12 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:17:12 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/console.log" append="off"/>
Nov 02 12:17:12 user nova-compute[74534]:     </serial>
Nov 02 12:17:12 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:17:12 user nova-compute[74534]:     <video>
Nov 02 12:17:12 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:17:12 user nova-compute[74534]:     </video>
Nov 02 12:17:12 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:17:12 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:17:12 user nova-compute[74534]:     </rng>
Nov 02 12:17:12 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:17:12 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:17:12 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:17:12 user nova-compute[74534]:     </memballoon>
Nov 02 12:17:12 user nova-compute[74534]:   </devices>
Nov 02 12:17:12 user nova-compute[74534]: </domain>
Nov 02 12:17:12 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-954059505',display_name='tempest-VolumesActionsTest-instance-954059505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-954059505',id=32,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cc76741e7745b5a49b4c7ee2a8c441',ramdisk_id='',reservation_id='r-15pvwz2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1016251624',owner_user_name='tempest-VolumesActionsTest-1016251624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:17:10Z,user_data=None,user_id='e713bb115ec8416ab1f2a51a93051233',uuid=851d34d6-c9f0-4db3-8e3b-5e31eba77479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Converting VIF {"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:89,bridge_name='br-int',has_traffic_filtering=True,id=b5750788-98de-44ce-9e0d-5aabea596de0,network=Network(301a023c-87d9-4d23-bd67-019e4de327b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5750788-98') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_vif [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:89,bridge_name='br-int',has_traffic_filtering=True,id=b5750788-98de-44ce-9e0d-5aabea596de0,network=Network(301a023c-87d9-4d23-bd67-019e4de327b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5750788-98') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1b0cb8c-30f3-5afb-843a-7bc336467eeb', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5750788-98, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5750788-98, col_values=(('qos', UUID('260d2311-c075-4d89-bae8-7f0e16fc6210')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5750788-98, col_values=(('external_ids', {'iface-id': 'b5750788-98de-44ce-9e0d-5aabea596de0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:ed:89', 'vm-uuid': '851d34d6-c9f0-4db3-8e3b-5e31eba77479'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:12 user nova-compute[74534]: INFO os_vif [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:89,bridge_name='br-int',has_traffic_filtering=True,id=b5750788-98de-44ce-9e0d-5aabea596de0,network=Network(301a023c-87d9-4d23-bd67-019e4de327b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5750788-98')
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] No VIF found with MAC fa:16:3e:ca:ed:89, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.815s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNehTLkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:17:12 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:12 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:12 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb1e861-813e-466f-814b-8a729c7ce531]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:17:12 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8056dc11-c855-45aa-890d-dcbbfb8d223b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f] added
Nov 02 12:17:12 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c85f15-74dd-4a6c-b156-bb9835cec9a4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c29b9b5-fd18-49c6-a624-761cc7295279]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNehTLkX {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNehTLkX" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d045f-b7de-47de-91f7-01a783f6f89d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VNehTLkX'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:13 user nova-compute[74534]: INFO nova.compute.manager [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Terminating instance
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d0427-e316-4a87-a2ee-e17e0894b1e1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef4f02a-994f-4ce2-8976-89e34347bf0f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c856000-ab35-42b6-ab4f-23cce6378ba1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260]
Nov 02 12:17:13 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260] successful.
Nov 02 12:17:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b539cd-c806-4e5e-b3e0-34913e2107ea]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a8fbc-2e19-4ac5-8086-9ab5d2133493]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:13 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:13 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf51d98-ad4b-442f-920c-ed2e07c39260]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-12b61fb9-8c72-4dbb-b242-811dc03c8320 req-72d42530-b5b6-4076-97fd-ac1037af2c92 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-vif-unplugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-12b61fb9-8c72-4dbb-b242-811dc03c8320 req-72d42530-b5b6-4076-97fd-ac1037af2c92 service nova] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-12b61fb9-8c72-4dbb-b242-811dc03c8320 req-72d42530-b5b6-4076-97fd-ac1037af2c92 service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-12b61fb9-8c72-4dbb-b242-811dc03c8320 req-72d42530-b5b6-4076-97fd-ac1037af2c92 service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-12b61fb9-8c72-4dbb-b242-811dc03c8320 req-72d42530-b5b6-4076-97fd-ac1037af2c92 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] No waiting events found dispatching network-vif-unplugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-12b61fb9-8c72-4dbb-b242-811dc03c8320 req-72d42530-b5b6-4076-97fd-ac1037af2c92 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-vif-unplugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNehTLkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23635343939623433', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635343939623433', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'flavor' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:17:14 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:17:14 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:17:14 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:17:14 user nova-compute[74534]:   <serial>38b35512-2c64-41f8-b40a-0f9bc049ae2f</serial>
Nov 02 12:17:14 user nova-compute[74534]: </disk>
Nov 02 12:17:14 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Instance destroyed successfully.
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lazy-loading 'resources' on Instance uuid e20af21c-b63b-4fd2-b4f3-8ca800894ea9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1567822340',display_name='tempest-VolumesAdminNegativeTest-server-1567822340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1567822340',id=18,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV5H7xvv80UoY0TFeniEVk5VOPBY+xcVSH/kZcB0++IfuXj6/q0y761CpMi3XDSbyvGIdsUJYfRKtHj4QfjeQHnLF/3uIJdrFQPXlt9ROkclpv3GNb+lpKdRQNIqg2IXA==',key_name='tempest-keypair-1708377516',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:10:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb39968885c2474e97da3a7e426c0e17',ramdisk_id='',reservation_id='r-dg0d4v9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1124753556',owner_user_name='tempest-VolumesAdminNegativeTest-1124753556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a71588ab6ed4d93aa359a76cbc9f7ac',uuid=e20af21c-b63b-4fd2-b4f3-8ca800894ea9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converting VIF {"id": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "address": "fa:16:3e:f9:54:3d", "network": {"id": "d9853908-d768-492f-a3ad-6d73a641af0a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-690139725-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb39968885c2474e97da3a7e426c0e17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4bee35-a8", "ovs_interfaceid": "1f4bee35-a830-4a42-bd66-801b00ae8d73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=1f4bee35-a830-4a42-bd66-801b00ae8d73,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4bee35-a8') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG os_vif [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=1f4bee35-a830-4a42-bd66-801b00ae8d73,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4bee35-a8') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4bee35-a8, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42312792-8a70-46c2-b8ff-e003d3d6bc79) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:17:14 user nova-compute[74534]: INFO os_vif [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=1f4bee35-a830-4a42-bd66-801b00ae8d73,network=Network(d9853908-d768-492f-a3ad-6d73a641af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4bee35-a8')
Nov 02 12:17:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Deleting instance files /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9_del
Nov 02 12:17:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Deletion of /opt/stack/data/nova/instances/e20af21c-b63b-4fd2-b4f3-8ca800894ea9_del complete
Nov 02 12:17:14 user nova-compute[74534]: INFO nova.compute.manager [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Took 1.59 seconds to destroy the instance on the hypervisor.
Nov 02 12:17:14 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-0f15c398-d1c8-49d2-b55d-0c7ef74ec682 req-e548f2dd-35ab-4841-bfcb-c59c0d0fb835 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received event network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0f15c398-d1c8-49d2-b55d-0c7ef74ec682 req-e548f2dd-35ab-4841-bfcb-c59c0d0fb835 service nova] Acquiring lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0f15c398-d1c8-49d2-b55d-0c7ef74ec682 req-e548f2dd-35ab-4841-bfcb-c59c0d0fb835 service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0f15c398-d1c8-49d2-b55d-0c7ef74ec682 req-e548f2dd-35ab-4841-bfcb-c59c0d0fb835 service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-0f15c398-d1c8-49d2-b55d-0c7ef74ec682 req-e548f2dd-35ab-4841-bfcb-c59c0d0fb835 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] No waiting events found dispatching network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:14 user nova-compute[74534]: WARNING nova.compute.manager [req-0f15c398-d1c8-49d2-b55d-0c7ef74ec682 req-e548f2dd-35ab-4841-bfcb-c59c0d0fb835 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received unexpected event network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 for instance with vm_state building and task_state spawning.
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No VIF found with MAC fa:16:3e:11:6f:36, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b538db2e-1274-4c49-a25b-0ce1e2879e9d tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.648s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-28aa5292-4477-4c15-80aa-7c8acf9a5e5e req-88490bd4-e70a-4138-8f3c-5391097abe94 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-28aa5292-4477-4c15-80aa-7c8acf9a5e5e req-88490bd4-e70a-4138-8f3c-5391097abe94 service nova] Acquiring lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-28aa5292-4477-4c15-80aa-7c8acf9a5e5e req-88490bd4-e70a-4138-8f3c-5391097abe94 service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-28aa5292-4477-4c15-80aa-7c8acf9a5e5e req-88490bd4-e70a-4138-8f3c-5391097abe94 service nova] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-28aa5292-4477-4c15-80aa-7c8acf9a5e5e req-88490bd4-e70a-4138-8f3c-5391097abe94 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] No waiting events found dispatching network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:15 user nova-compute[74534]: WARNING nova.compute.manager [req-28aa5292-4477-4c15-80aa-7c8acf9a5e5e req-88490bd4-e70a-4138-8f3c-5391097abe94 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received unexpected event network-vif-plugged-1f4bee35-a830-4a42-bd66-801b00ae8d73 for instance with vm_state active and task_state deleting.
Nov 02 12:17:15 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:15 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Took 1.22 seconds to deallocate network for instance.
Nov 02 12:17:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:16 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Deleted allocations for instance e20af21c-b63b-4fd2-b4f3-8ca800894ea9
Nov 02 12:17:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1a068c02-776e-439c-8abe-787e97eacbcb tempest-VolumesAdminNegativeTest-1124753556 tempest-VolumesAdminNegativeTest-1124753556-project-member] Lock "e20af21c-b63b-4fd2-b4f3-8ca800894ea9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.645s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-34408c4b-11a7-4aee-b337-4140e7376c82 req-0af7d0e1-d4de-4bfe-b864-46399ad9a949 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received event network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-34408c4b-11a7-4aee-b337-4140e7376c82 req-0af7d0e1-d4de-4bfe-b864-46399ad9a949 service nova] Acquiring lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-34408c4b-11a7-4aee-b337-4140e7376c82 req-0af7d0e1-d4de-4bfe-b864-46399ad9a949 service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-34408c4b-11a7-4aee-b337-4140e7376c82 req-0af7d0e1-d4de-4bfe-b864-46399ad9a949 service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-34408c4b-11a7-4aee-b337-4140e7376c82 req-0af7d0e1-d4de-4bfe-b864-46399ad9a949 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] No waiting events found dispatching network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:16 user nova-compute[74534]: WARNING nova.compute.manager [req-34408c4b-11a7-4aee-b337-4140e7376c82 req-0af7d0e1-d4de-4bfe-b864-46399ad9a949 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received unexpected event network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 for instance with vm_state building and task_state spawning.
Nov 02 12:17:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-34408c4b-11a7-4aee-b337-4140e7376c82 req-0af7d0e1-d4de-4bfe-b864-46399ad9a949 service nova] [instance: e20af21c-b63b-4fd2-b4f3-8ca800894ea9] Received event network-vif-deleted-1f4bee35-a830-4a42-bd66-801b00ae8d73 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:17:17 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Instance spawned successfully.
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:17 user nova-compute[74534]: INFO nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Took 7.59 seconds to spawn the instance on the hypervisor.
Nov 02 12:17:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:17:17 user nova-compute[74534]: INFO nova.compute.manager [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Took 9.00 seconds to build instance.
Nov 02 12:17:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a0e7541a-e4ca-41e2-8ad0-3c6a6f9c6b15 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.222s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'flavor' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:19 user nova-compute[74534]: INFO nova.compute.manager [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Attaching volume 532fc70e-30b0-477d-a888-ec05f211f0c8 to /dev/vdc
Nov 02 12:17:19 user nova-compute[74534]: DEBUG os_brick.utils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b34861f-83f3-492b-bd59-cf99fe93291d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440d777-5393-4170-9fa0-fed245a98449]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a84fccf-fa8f-4d87-b98f-fd111c92e5c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10d62c5-55a3-4253-ba92-4e3ff2725fb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:17:19 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:17:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487a581-0ae2-48b2-97be-bf13f2a3c1d4]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG os_brick.utils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updating existing volume attachment record: 6afff290-ee30-4d6e-ae44-7d1bc946f4c4 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:17:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:17:27 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Creating image(s)
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Ensure instance console log exists: /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Start _get_guest_xml network_info=[{"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e9e4ead8-742e-4943-98e3-5e1b87213420', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuTgXEUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1dd3521d-944a-4d86-bcf5-d5988b6f923c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6225913-83b4-42e7-90cd-57cdab9676bb', 'serial': 'd6225913-83b4-42e7-90cd-57cdab9676bb'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:17:27 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:27 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuTgXEUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:17:27 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:27 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:27 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe1c32-86f3-4625-9a3d-4155439c5260]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:17:27 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd04759-6d51-4a10-9dfa-fa111e4da52a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb] added
Nov 02 12:17:27 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1005683-260c-4433-a23a-af03e981ff16]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c064b8c2-09ae-48b9-8ab1-ba9783dfa313]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuTgXEUc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuTgXEUc" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[88968869-67cc-40b9-95ea-107dca51f314]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuTgXEUc'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[166b4990-4b07-4036-a7a7-4e2cd9622d4c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d739df-5add-487f-8456-25a287b6f635]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:27 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:27 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:27 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:27 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1697d28-7ef6-41a1-bdbe-38d7d6ec1499]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260]
Nov 02 12:17:27 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260] successful.
Nov 02 12:17:27 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e47c6c-bce9-4d38-a609-eea822a226f0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93abb5c-038a-4f8e-b6b4-4d75e89f9d73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:27 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:27 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:27 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:27 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:27 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:27 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[12124531-7761-4ebe-bc79-55e0156ab039]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:17:27 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuTgXEUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26461663936313964', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461663936313964', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2052723514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2052723514',id=30,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-bg38yprw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:16:33Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=1dd3521d-944a-4d86-bcf5-d5988b6f923c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:17:28 user nova-compute[74534]:   <uuid>1dd3521d-944a-4d86-bcf5-d5988b6f923c</uuid>
Nov 02 12:17:28 user nova-compute[74534]:   <name>instance-0000001e</name>
Nov 02 12:17:28 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:17:28 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:17:28 user nova-compute[74534]:   <metadata>
Nov 02 12:17:28 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:17:28 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:17:28 user nova-compute[74534]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2052723514</nova:name>
Nov 02 12:17:28 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:17:27</nova:creationTime>
Nov 02 12:17:28 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:17:28 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:17:28 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:17:28 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:17:28 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:17:28 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:17:28 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:17:28 user nova-compute[74534]:       <nova:owner>
Nov 02 12:17:28 user nova-compute[74534]:         <nova:user uuid="caf5cde0e75e444da00c7bcda4bcdd28">tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member</nova:user>
Nov 02 12:17:28 user nova-compute[74534]:         <nova:project uuid="25ccb20fcd184ecebd3707d9d93c8817">tempest-ServerBootFromVolumeStableRescueTest-1363504210</nova:project>
Nov 02 12:17:28 user nova-compute[74534]:       </nova:owner>
Nov 02 12:17:28 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:17:28 user nova-compute[74534]:       <nova:ports>
Nov 02 12:17:28 user nova-compute[74534]:         <nova:port uuid="dc473798-99ef-4267-9840-e445a25d7322">
Nov 02 12:17:28 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:17:28 user nova-compute[74534]:         </nova:port>
Nov 02 12:17:28 user nova-compute[74534]:       </nova:ports>
Nov 02 12:17:28 user nova-compute[74534]:     </nova:instance>
Nov 02 12:17:28 user nova-compute[74534]:   </metadata>
Nov 02 12:17:28 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:17:28 user nova-compute[74534]:     <system>
Nov 02 12:17:28 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:17:28 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:17:28 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:17:28 user nova-compute[74534]:       <entry name="serial">1dd3521d-944a-4d86-bcf5-d5988b6f923c</entry>
Nov 02 12:17:28 user nova-compute[74534]:       <entry name="uuid">1dd3521d-944a-4d86-bcf5-d5988b6f923c</entry>
Nov 02 12:17:28 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:17:28 user nova-compute[74534]:     </system>
Nov 02 12:17:28 user nova-compute[74534]:   </sysinfo>
Nov 02 12:17:28 user nova-compute[74534]:   <os>
Nov 02 12:17:28 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:17:28 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:17:28 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:17:28 user nova-compute[74534]:   </os>
Nov 02 12:17:28 user nova-compute[74534]:   <features>
Nov 02 12:17:28 user nova-compute[74534]:     <acpi/>
Nov 02 12:17:28 user nova-compute[74534]:     <apic/>
Nov 02 12:17:28 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:17:28 user nova-compute[74534]:   </features>
Nov 02 12:17:28 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:17:28 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:17:28 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:17:28 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:17:28 user nova-compute[74534]:   </clock>
Nov 02 12:17:28 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:17:28 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:17:28 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:17:28 user nova-compute[74534]:   </cpu>
Nov 02 12:17:28 user nova-compute[74534]:   <devices>
Nov 02 12:17:28 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:17:28 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:17:28 user nova-compute[74534]:       <source dev="/dev/sdc"/>
Nov 02 12:17:28 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:17:28 user nova-compute[74534]:       <serial>d6225913-83b4-42e7-90cd-57cdab9676bb</serial>
Nov 02 12:17:28 user nova-compute[74534]:     </disk>
Nov 02 12:17:28 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:17:28 user nova-compute[74534]:       <mac address="fa:16:3e:04:cc:52"/>
Nov 02 12:17:28 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:17:28 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:17:28 user nova-compute[74534]:       <target dev="tapdc473798-99"/>
Nov 02 12:17:28 user nova-compute[74534]:     </interface>
Nov 02 12:17:28 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:17:28 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/console.log" append="off"/>
Nov 02 12:17:28 user nova-compute[74534]:     </serial>
Nov 02 12:17:28 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:17:28 user nova-compute[74534]:     <video>
Nov 02 12:17:28 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:17:28 user nova-compute[74534]:     </video>
Nov 02 12:17:28 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:17:28 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:17:28 user nova-compute[74534]:     </rng>
Nov 02 12:17:28 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:17:28 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:17:28 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:17:28 user nova-compute[74534]:     </memballoon>
Nov 02 12:17:28 user nova-compute[74534]:   </devices>
Nov 02 12:17:28 user nova-compute[74534]: </domain>
Nov 02 12:17:28 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2052723514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2052723514',id=30,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-bg38yprw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:16:33Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=1dd3521d-944a-4d86-bcf5-d5988b6f923c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG os_vif [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99a8fd0b-0cba-5668-9dec-0e427ead5fc1', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc473798-99, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc473798-99, col_values=(('qos', UUID('85ee11dd-46b1-4199-aad4-e916827a2e1d')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc473798-99, col_values=(('external_ids', {'iface-id': 'dc473798-99ef-4267-9840-e445a25d7322', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:cc:52', 'vm-uuid': '1dd3521d-944a-4d86-bcf5-d5988b6f923c'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:17:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:28 user nova-compute[74534]: INFO os_vif [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99')
Nov 02 12:17:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No VIF found with MAC fa:16:3e:04:cc:52, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-077cb76b-958c-4592-84a3-a8f60ae73361 req-096c1167-8154-4324-92f4-d97cf80637a3 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-077cb76b-958c-4592-84a3-a8f60ae73361 req-096c1167-8154-4324-92f4-d97cf80637a3 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-077cb76b-958c-4592-84a3-a8f60ae73361 req-096c1167-8154-4324-92f4-d97cf80637a3 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-077cb76b-958c-4592-84a3-a8f60ae73361 req-096c1167-8154-4324-92f4-d97cf80637a3 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-077cb76b-958c-4592-84a3-a8f60ae73361 req-096c1167-8154-4324-92f4-d97cf80637a3 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:30 user nova-compute[74534]: WARNING nova.compute.manager [req-077cb76b-958c-4592-84a3-a8f60ae73361 req-096c1167-8154-4324-92f4-d97cf80637a3 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state building and task_state spawning.
Nov 02 12:17:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:17:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Creating image(s)
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Ensure instance console log exists: /opt/stack/data/nova/instances/b7864c94-0468-459b-9f5e-86e85c28efed/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Start _get_guest_xml network_info=[{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'daae7c69-e5ee-48ea-88cd-9667d8014d6d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7864c94-0468-459b-9f5e-86e85c28efed', 'attached_at': '', 'detached_at': '', 'volume_id': '2984cf70-c44e-4474-863c-ea3f87f96db1', 'serial': '2984cf70-c44e-4474-863c-ea3f87f96db1'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:17:31 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:31 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:17:31 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:31 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:31 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2b7617-789c-4a54-9890-7fa7ec5394d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:17:31 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f0ca44-42ac-4400-9ef8-f774e7e84ec0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1] added
Nov 02 12:17:31 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa09a933-b565-4e5e-852a-b667af0cbff2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5337e13f-4eab-4f17-a7f9-10b5326edada]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndFiYehR {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndFiYehR" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd6f96d-e376-45c3-b530-7b79092c1ca1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ndFiYehR'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcab39e0-bd74-4393-92c5-77f7c1c5c1f8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e360b5-d8e3-45dc-b95d-5189dab4c16e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:31 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:31 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfbbb95-1959-48c6-a1c3-8598db7fafb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]
Nov 02 12:17:31 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.
Nov 02 12:17:31 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[067aeae1-6672-4965-b878-9c8dfa325a8b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee79dac-079f-4998-be4e-714e810a4b0c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:17:31 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:31 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:17:31 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c3f38-286b-4670-a846-5faefa38d0a3]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:31 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-629075d3-4107-4a84-9d57-52459d08cff6 req-4c6a7747-5ae7-4476-b909-0a204c661e88 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-629075d3-4107-4a84-9d57-52459d08cff6 req-4c6a7747-5ae7-4476-b909-0a204c661e88 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-629075d3-4107-4a84-9d57-52459d08cff6 req-4c6a7747-5ae7-4476-b909-0a204c661e88 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-629075d3-4107-4a84-9d57-52459d08cff6 req-4c6a7747-5ae7-4476-b909-0a204c661e88 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-629075d3-4107-4a84-9d57-52459d08cff6 req-4c6a7747-5ae7-4476-b909-0a204c661e88 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:32 user nova-compute[74534]: WARNING nova.compute.manager [req-629075d3-4107-4a84-9d57-52459d08cff6 req-4c6a7747-5ae7-4476-b909-0a204c661e88 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state building and task_state spawning.
Nov 02 12:17:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23634343061383964', 'path': '/dev/sde'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634343061383964', 'path': '/dev/sde'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344270638',display_name='tempest-ServerActionsTestOtherA-server-1344270638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344270638',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-dn1kg9xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=b7864c94-0468-459b-9f5e-86e85c28efed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.objects.instance [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'pci_devices' on Instance uuid b7864c94-0468-459b-9f5e-86e85c28efed {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:17:32 user nova-compute[74534]:   <uuid>b7864c94-0468-459b-9f5e-86e85c28efed</uuid>
Nov 02 12:17:32 user nova-compute[74534]:   <name>instance-0000001f</name>
Nov 02 12:17:32 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:17:32 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:17:32 user nova-compute[74534]:   <metadata>
Nov 02 12:17:32 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:17:32 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:17:32 user nova-compute[74534]:       <nova:name>tempest-ServerActionsTestOtherA-server-1344270638</nova:name>
Nov 02 12:17:32 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:17:31</nova:creationTime>
Nov 02 12:17:32 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:17:32 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:17:32 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:17:32 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:17:32 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:17:32 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:17:32 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:17:32 user nova-compute[74534]:       <nova:owner>
Nov 02 12:17:32 user nova-compute[74534]:         <nova:user uuid="ec72fd62d437457ba42756f1da97516c">tempest-ServerActionsTestOtherA-500741581-project-member</nova:user>
Nov 02 12:17:32 user nova-compute[74534]:         <nova:project uuid="f787c9b1e8154b4da75ac5299c888706">tempest-ServerActionsTestOtherA-500741581</nova:project>
Nov 02 12:17:32 user nova-compute[74534]:       </nova:owner>
Nov 02 12:17:32 user nova-compute[74534]:       <nova:ports>
Nov 02 12:17:32 user nova-compute[74534]:         <nova:port uuid="9ce301a6-44ca-4ef0-81ce-3fa446504903">
Nov 02 12:17:32 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:17:32 user nova-compute[74534]:         </nova:port>
Nov 02 12:17:32 user nova-compute[74534]:       </nova:ports>
Nov 02 12:17:32 user nova-compute[74534]:     </nova:instance>
Nov 02 12:17:32 user nova-compute[74534]:   </metadata>
Nov 02 12:17:32 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:17:32 user nova-compute[74534]:     <system>
Nov 02 12:17:32 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:17:32 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:17:32 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:17:32 user nova-compute[74534]:       <entry name="serial">b7864c94-0468-459b-9f5e-86e85c28efed</entry>
Nov 02 12:17:32 user nova-compute[74534]:       <entry name="uuid">b7864c94-0468-459b-9f5e-86e85c28efed</entry>
Nov 02 12:17:32 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:17:32 user nova-compute[74534]:     </system>
Nov 02 12:17:32 user nova-compute[74534]:   </sysinfo>
Nov 02 12:17:32 user nova-compute[74534]:   <os>
Nov 02 12:17:32 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:17:32 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:17:32 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:17:32 user nova-compute[74534]:   </os>
Nov 02 12:17:32 user nova-compute[74534]:   <features>
Nov 02 12:17:32 user nova-compute[74534]:     <acpi/>
Nov 02 12:17:32 user nova-compute[74534]:     <apic/>
Nov 02 12:17:32 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:17:32 user nova-compute[74534]:   </features>
Nov 02 12:17:32 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:17:32 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:17:32 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:17:32 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:17:32 user nova-compute[74534]:   </clock>
Nov 02 12:17:32 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:17:32 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:17:32 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:17:32 user nova-compute[74534]:   </cpu>
Nov 02 12:17:32 user nova-compute[74534]:   <devices>
Nov 02 12:17:32 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:17:32 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:17:32 user nova-compute[74534]:       <source dev="/dev/sde"/>
Nov 02 12:17:32 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:17:32 user nova-compute[74534]:       <serial>2984cf70-c44e-4474-863c-ea3f87f96db1</serial>
Nov 02 12:17:32 user nova-compute[74534]:     </disk>
Nov 02 12:17:32 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:17:32 user nova-compute[74534]:       <mac address="fa:16:3e:21:4c:09"/>
Nov 02 12:17:32 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:17:32 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:17:32 user nova-compute[74534]:       <target dev="tap9ce301a6-44"/>
Nov 02 12:17:32 user nova-compute[74534]:     </interface>
Nov 02 12:17:32 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:17:32 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/b7864c94-0468-459b-9f5e-86e85c28efed/console.log" append="off"/>
Nov 02 12:17:32 user nova-compute[74534]:     </serial>
Nov 02 12:17:32 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:17:32 user nova-compute[74534]:     <video>
Nov 02 12:17:32 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:17:32 user nova-compute[74534]:     </video>
Nov 02 12:17:32 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:17:32 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:17:32 user nova-compute[74534]:     </rng>
Nov 02 12:17:32 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:17:32 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:17:32 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:17:32 user nova-compute[74534]:     </memballoon>
Nov 02 12:17:32 user nova-compute[74534]:   </devices>
Nov 02 12:17:32 user nova-compute[74534]: </domain>
Nov 02 12:17:32 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344270638',display_name='tempest-ServerActionsTestOtherA-server-1344270638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344270638',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-dn1kg9xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=b7864c94-0468-459b-9f5e-86e85c28efed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG os_vif [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '370d3980-d3eb-5ba7-bf86-20e80e6b1e32', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ce301a6-44, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ce301a6-44, col_values=(('qos', UUID('6e489729-97d9-4db6-b935-a18254e6cf60')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ce301a6-44, col_values=(('external_ids', {'iface-id': '9ce301a6-44ca-4ef0-81ce-3fa446504903', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:4c:09', 'vm-uuid': 'b7864c94-0468-459b-9f5e-86e85c28efed'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:32 user nova-compute[74534]: INFO os_vif [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44')
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No VIF found with MAC fa:16:3e:21:4c:09, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:17:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance spawned successfully.
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:32 user nova-compute[74534]: INFO nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 02 12:17:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:17:33 user nova-compute[74534]: INFO nova.compute.manager [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Took 61.33 seconds to build instance.
Nov 02 12:17:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2d382f0b-ad57-492c-9b07-1a33106adf2a tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 61.438s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-cdf2a8fc-18d1-4730-83e3-a3ceff317639 req-6c019a2f-e067-41d4-a278-a109d9829a61 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cdf2a8fc-18d1-4730-83e3-a3ceff317639 req-6c019a2f-e067-41d4-a278-a109d9829a61 service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cdf2a8fc-18d1-4730-83e3-a3ceff317639 req-6c019a2f-e067-41d4-a278-a109d9829a61 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cdf2a8fc-18d1-4730-83e3-a3ceff317639 req-6c019a2f-e067-41d4-a278-a109d9829a61 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-cdf2a8fc-18d1-4730-83e3-a3ceff317639 req-6c019a2f-e067-41d4-a278-a109d9829a61 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:34 user nova-compute[74534]: WARNING nova.compute.manager [req-cdf2a8fc-18d1-4730-83e3-a3ceff317639 req-6c019a2f-e067-41d4-a278-a109d9829a61 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received unexpected event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with vm_state building and task_state spawning.
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-f70effd6-e3c6-439e-a6b7-50b84ea975df req-3c4b9b51-3e56-483f-9380-94a9ea2ba2b1 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f70effd6-e3c6-439e-a6b7-50b84ea975df req-3c4b9b51-3e56-483f-9380-94a9ea2ba2b1 service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f70effd6-e3c6-439e-a6b7-50b84ea975df req-3c4b9b51-3e56-483f-9380-94a9ea2ba2b1 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f70effd6-e3c6-439e-a6b7-50b84ea975df req-3c4b9b51-3e56-483f-9380-94a9ea2ba2b1 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-f70effd6-e3c6-439e-a6b7-50b84ea975df req-3c4b9b51-3e56-483f-9380-94a9ea2ba2b1 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:36 user nova-compute[74534]: WARNING nova.compute.manager [req-f70effd6-e3c6-439e-a6b7-50b84ea975df req-3c4b9b51-3e56-483f-9380-94a9ea2ba2b1 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received unexpected event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with vm_state building and task_state spawning.
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:17:36 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance spawned successfully.
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:17:36 user nova-compute[74534]: INFO nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 02 12:17:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:17:36 user nova-compute[74534]: INFO nova.compute.manager [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Took 30.94 seconds to build instance.
Nov 02 12:17:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9d4e846d-cc76-4b5e-87af-c446b133b9e3 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.075s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBCidKWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:17:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:17:42 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2d1fe-3432-411a-92a7-f5052a5d6ded]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:17:42 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8815d3d-83cb-464b-8f51-d64ee177ef4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8] added
Nov 02 12:17:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[739fc687-982d-4596-afe6-73573858a33b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[12255e29-c333-4797-92be-8c849d129273]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBCidKWL {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBCidKWL" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4bde7d-6f1c-4449-8f7b-246391e48e44]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YBCidKWL'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bd3bcf-cfb9-4a9a-8c17-a6dc6bafc878]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9012e440-5cf8-4c9e-9627-1771cbe48262]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a03b98-d3c3-4dd9-be2e-daba896f5cd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260]
Nov 02 12:17:42 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260] successful.
Nov 02 12:17:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d9a0a7-1928-499a-8fac-a1c5e1bcc8cb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df4c4ad-7287-41e5-9e7e-d8e06d8fa483]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 (non-flash)
Nov 02 12:17:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[529f195c-db4c-41db-aaef-ec136303f2de]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBCidKWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:17:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26364323934386137', 'path': '/dev/sdf'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364323934386137', 'path': '/dev/sdf'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'flavor' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:17:43 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:17:43 user nova-compute[74534]:   <source dev="/dev/sdf"/>
Nov 02 12:17:43 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:17:43 user nova-compute[74534]:   <serial>532fc70e-30b0-477d-a888-ec05f211f0c8</serial>
Nov 02 12:17:43 user nova-compute[74534]: </disk>
Nov 02 12:17:43 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:17:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] No VIF found with MAC fa:16:3e:11:6f:36, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:17:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e32d7cbf-a617-4729-8638-11a4860f676a tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.851s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:45 user nova-compute[74534]: INFO nova.compute.manager [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Detaching volume 532fc70e-30b0-477d-a888-ec05f211f0c8
Nov 02 12:17:45 user nova-compute[74534]: INFO nova.virt.block_device [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Attempting to driver detach volume 532fc70e-30b0-477d-a888-ec05f211f0c8 from mountpoint /dev/vdc
Nov 02 12:17:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Attempting to detach device vdc from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:17:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:17:45 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:17:45 user nova-compute[74534]:   <source dev="/dev/sdf"/>
Nov 02 12:17:45 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:17:45 user nova-compute[74534]:   <serial>532fc70e-30b0-477d-a888-ec05f211f0c8</serial>
Nov 02 12:17:45 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 12:17:45 user nova-compute[74534]: </disk>
Nov 02 12:17:45 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:17:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Successfully detached device vdc from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the persistent domain config.
Nov 02 12:17:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:17:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:17:45 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:17:45 user nova-compute[74534]:   <source dev="/dev/sdf"/>
Nov 02 12:17:45 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:17:45 user nova-compute[74534]:   <serial>532fc70e-30b0-477d-a888-ec05f211f0c8</serial>
Nov 02 12:17:45 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 12:17:45 user nova-compute[74534]: </disk>
Nov 02 12:17:45 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:17:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:17:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:48 user nova-compute[74534]: INFO nova.compute.manager [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Terminating instance
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e092140-9654-4f07-811c-f969444ead3d req-3faddcf2-4bbe-4197-92fe-bc89b4e247be service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received event network-vif-unplugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e092140-9654-4f07-811c-f969444ead3d req-3faddcf2-4bbe-4197-92fe-bc89b4e247be service nova] Acquiring lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e092140-9654-4f07-811c-f969444ead3d req-3faddcf2-4bbe-4197-92fe-bc89b4e247be service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e092140-9654-4f07-811c-f969444ead3d req-3faddcf2-4bbe-4197-92fe-bc89b4e247be service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e092140-9654-4f07-811c-f969444ead3d req-3faddcf2-4bbe-4197-92fe-bc89b4e247be service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] No waiting events found dispatching network-vif-unplugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e092140-9654-4f07-811c-f969444ead3d req-3faddcf2-4bbe-4197-92fe-bc89b4e247be service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received event network-vif-unplugged-7a3633e2-d643-4fc8-a355-bb32629d66bb for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Instance destroyed successfully.
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lazy-loading 'resources' on Instance uuid 90f3207f-f0b7-42b5-af22-3f07ecfd7425 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2010208991',display_name='tempest-ServersNegativeTestJSON-server-2010208991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2010208991',id=27,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:16:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38c4b94f48eb458589f03332ebb35a87',ramdisk_id='',reservation_id='r-y4quhs7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1439847488',owner_user_name='tempest-ServersNegativeTestJSON-1439847488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:16:05Z,user_data=None,user_id='dae37e0cfa414111b89952d130d4fbf2',uuid=90f3207f-f0b7-42b5-af22-3f07ecfd7425,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converting VIF {"id": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "address": "fa:16:3e:b5:91:ee", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3633e2-d6", "ovs_interfaceid": "7a3633e2-d643-4fc8-a355-bb32629d66bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=7a3633e2-d643-4fc8-a355-bb32629d66bb,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3633e2-d6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG os_vif [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=7a3633e2-d643-4fc8-a355-bb32629d66bb,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3633e2-d6') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a3633e2-d6, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bbc49b2-8155-408c-b0b5-605953fd1ff3) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:48 user nova-compute[74534]: INFO os_vif [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=7a3633e2-d643-4fc8-a355-bb32629d66bb,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3633e2-d6')
Nov 02 12:17:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Deleting instance files /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425_del
Nov 02 12:17:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Deletion of /opt/stack/data/nova/instances/90f3207f-f0b7-42b5-af22-3f07ecfd7425_del complete
Nov 02 12:17:48 user nova-compute[74534]: INFO nova.compute.manager [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 02 12:17:48 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:17:48 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:17:49 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:49 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Took 0.51 seconds to deallocate network for instance.
Nov 02 12:17:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-f2ef9b16-2650-478d-bede-08f69aa30c83 req-2c4ef904-4995-4d40-ac43-47e0f8d05a8e service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received event network-vif-deleted-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:49 user nova-compute[74534]: INFO nova.compute.manager [req-f2ef9b16-2650-478d-bede-08f69aa30c83 req-2c4ef904-4995-4d40-ac43-47e0f8d05a8e service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Neutron deleted interface 7a3633e2-d643-4fc8-a355-bb32629d66bb; detaching it from the instance and deleting it from the info cache
Nov 02 12:17:49 user nova-compute[74534]: DEBUG nova.network.neutron [req-f2ef9b16-2650-478d-bede-08f69aa30c83 req-2c4ef904-4995-4d40-ac43-47e0f8d05a8e service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:17:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-f2ef9b16-2650-478d-bede-08f69aa30c83 req-2c4ef904-4995-4d40-ac43-47e0f8d05a8e service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Detach interface failed, port_id=7a3633e2-d643-4fc8-a355-bb32629d66bb, reason: Instance 90f3207f-f0b7-42b5-af22-3f07ecfd7425 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:17:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:49 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:17:49 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:17:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:50 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Deleted allocations for instance 90f3207f-f0b7-42b5-af22-3f07ecfd7425
Nov 02 12:17:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3c238802-9a60-40b3-9601-27fad71f2028 tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-8db932bc-6d71-4553-84e1-b8f0da470700 req-df83317a-c7dc-4d45-86fb-72c26d8b96bc service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received event network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:17:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8db932bc-6d71-4553-84e1-b8f0da470700 req-df83317a-c7dc-4d45-86fb-72c26d8b96bc service nova] Acquiring lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:17:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8db932bc-6d71-4553-84e1-b8f0da470700 req-df83317a-c7dc-4d45-86fb-72c26d8b96bc service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:17:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8db932bc-6d71-4553-84e1-b8f0da470700 req-df83317a-c7dc-4d45-86fb-72c26d8b96bc service nova] Lock "90f3207f-f0b7-42b5-af22-3f07ecfd7425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:17:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-8db932bc-6d71-4553-84e1-b8f0da470700 req-df83317a-c7dc-4d45-86fb-72c26d8b96bc service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] No waiting events found dispatching network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:17:50 user nova-compute[74534]: WARNING nova.compute.manager [req-8db932bc-6d71-4553-84e1-b8f0da470700 req-df83317a-c7dc-4d45-86fb-72c26d8b96bc service nova] [instance: 90f3207f-f0b7-42b5-af22-3f07ecfd7425] Received unexpected event network-vif-plugged-7a3633e2-d643-4fc8-a355-bb32629d66bb for instance with vm_state deleted and task_state None.
Nov 02 12:17:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:17:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:17:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:18:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:18:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:18:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:18:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff is timed out.
Nov 02 12:18:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Successfully detached device vdc from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the live domain config.
Nov 02 12:18:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBCidKWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:18:05 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed351038-fc2d-49af-9d53-2a4170e76fa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:18:05 user nova-compute[74534]: No targets found.
Nov 02 12:18:05 user nova-compute[74534]: iSNS:
Nov 02 12:18:05 user nova-compute[74534]: No targets found.
Nov 02 12:18:05 user nova-compute[74534]: STATIC:
Nov 02 12:18:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:18:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8
Nov 02 12:18:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:18:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f
Nov 02 12:18:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:18:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:05 user nova-compute[74534]: FIRMWARE:
Nov 02 12:18:05 user nova-compute[74534]: No targets found.
Nov 02 12:18:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:18:05 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:18:05 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8895ec-2395-4b69-822c-c0f63d1a50bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef7344-519e-427b-82da-e9f824ca9b7d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 (non-flash)
Nov 02 12:18:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:05 user nova-compute[74534]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 (non-flash)
Nov 02 12:18:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c7a5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8'): ({'sdf'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Removing single pathed devices sdf {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5820859a-5a5a-4ad0-8783-5d83482d92eb]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[df54103f-a1c4-4249-8c56-a6fbc7b70e08]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Flushing IO for device /dev/sdf {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5834e26-c86f-4662-91f5-828ed44a4798]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[04519ceb-82aa-4a73-8dd8-1ecac3894d36]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[90295a48-fefe-44a7-a832-5e2bac61c9e3]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba1737d-c006-476f-9ea5-10b89d4360cf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260]
Nov 02 12:18:05 user nova-compute[74534]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8, portal: 172.16.0.220,3260] successful.
Nov 02 12:18:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532fc70e-30b0-477d-a888-ec05f211f0c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60b69f1-e91c-43f8-9f82-00aee40d1525]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] <== disconnect_volume: return (316ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:18:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:18:06 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'flavor' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:18:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5fee9d1-672e-421c-9349-0a572c95f7d7 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:18:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:18:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7020MB free_disk=25.039051055908203GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 868612a8-7a46-400e-add0-4eb7374ca056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance af8aed6f-de40-47e9-a777-0122aac6e29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 851d34d6-c9f0-4db3-8e3b-5e31eba77479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:18:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:18:13 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:18:13 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:18:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:18:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received event network-changed-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Refreshing instance network info cache due to event network-changed-3ce1e36c-386e-4249-8b97-dfc61c15ad5a. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] Acquiring lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] Acquired lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Refreshing network info cache for port 3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updated VIF entry in instance network info cache for port 3ce1e36c-386e-4249-8b97-dfc61c15ad5a. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updating instance_info_cache with network_info: [{"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:18:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbce7394-367f-41a0-a4df-d8abe42fdfab req-332ad1cf-4056-4644-99cf-bd148cdb1973 service nova] Releasing lock "refresh_cache-868612a8-7a46-400e-add0-4eb7374ca056" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:18:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:21 user nova-compute[74534]: INFO nova.compute.manager [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Attaching volume c63f913f-63ef-4f50-8232-d41d2f0919f2 to /dev/vdb
Nov 02 12:18:21 user nova-compute[74534]: DEBUG os_brick.utils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f83f2b-86fa-47b9-a911-9ece116dfcf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5763d4-e448-4462-a892-1940550d214e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ee3b5-55d1-4c51-9489-b9400c1f93c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a665bd-ff06-4e01-91f4-6ca8b5c42848]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:18:21 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:18:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d0563-0aea-4369-91ef-45e309c7086a]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG os_brick.utils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:18:21 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updating existing volume attachment record: de81f311-20b5-4265-801a-b0f6288a8bfa {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-changed-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Refreshing instance network info cache due to event network-changed-6d2cb6a4-7508-4329-9906-e16f5e08123c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] Acquiring lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] Acquired lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Refreshing network info cache for port 6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updated VIF entry in instance network info cache for port 6d2cb6a4-7508-4329-9906-e16f5e08123c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updating instance_info_cache with network_info: [{"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:18:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e567475-4a35-46d8-b462-e0614d1bbf1f req-97079753-59d8-4902-9b49-ba276f4ce446 service nova] Releasing lock "refresh_cache-af8aed6f-de40-47e9-a777-0122aac6e29c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:18:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:26 user nova-compute[74534]: INFO nova.compute.manager [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Unrescuing
Nov 02 12:18:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'flavor' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-c04d5f30-3e46-4795-8d4b-82b852cbe30e req-111b1ff9-47c9-4b6d-baf9-166c2768a860 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c04d5f30-3e46-4795-8d4b-82b852cbe30e req-111b1ff9-47c9-4b6d-baf9-166c2768a860 service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c04d5f30-3e46-4795-8d4b-82b852cbe30e req-111b1ff9-47c9-4b6d-baf9-166c2768a860 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c04d5f30-3e46-4795-8d4b-82b852cbe30e req-111b1ff9-47c9-4b6d-baf9-166c2768a860 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:26 user nova-compute[74534]: DEBUG nova.compute.manager [req-c04d5f30-3e46-4795-8d4b-82b852cbe30e req-111b1ff9-47c9-4b6d-baf9-166c2768a860 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:18:26 user nova-compute[74534]: WARNING nova.compute.manager [req-c04d5f30-3e46-4795-8d4b-82b852cbe30e req-111b1ff9-47c9-4b6d-baf9-166c2768a860 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:18:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:27 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance destroyed successfully.
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG nova.objects.instance [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid af8aed6f-de40-47e9-a777-0122aac6e29c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:28 user nova-compute[74534]: INFO nova.compute.manager [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Attaching volume 26430f6a-72b8-4f44-9015-d01e008e5e63 to /dev/vdb
Nov 02 12:18:28 user nova-compute[74534]: DEBUG os_brick.utils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab74d2d8-5a89-4738-97dd-e530031e3eb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8638d0fc-4d25-4db2-afc7-0e03a65afe40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2348888-1fa6-4ac9-92ee-63be65de8fbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[071d4b0c-4b30-457b-a96e-ded23a4d5669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:18:28 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:18:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[197229e6-3d63-4f61-bf3b-c145741ce00b]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG os_brick.utils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updating existing volume attachment record: 15e80ac4-ea16-427e-af20-c51d7fa6b772 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-eaefbf03-d5ae-408b-a581-1a76eed3a6ba req-81216b0e-7e62-4291-a98f-04c43210488c service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eaefbf03-d5ae-408b-a581-1a76eed3a6ba req-81216b0e-7e62-4291-a98f-04c43210488c service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eaefbf03-d5ae-408b-a581-1a76eed3a6ba req-81216b0e-7e62-4291-a98f-04c43210488c service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eaefbf03-d5ae-408b-a581-1a76eed3a6ba req-81216b0e-7e62-4291-a98f-04c43210488c service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-eaefbf03-d5ae-408b-a581-1a76eed3a6ba req-81216b0e-7e62-4291-a98f-04c43210488c service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:18:29 user nova-compute[74534]: WARNING nova.compute.manager [req-eaefbf03-d5ae-408b-a581-1a76eed3a6ba req-81216b0e-7e62-4291-a98f-04c43210488c service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:18:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:18:31 user nova-compute[74534]: WARNING nova.compute.manager [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:18:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:18:31 user nova-compute[74534]: WARNING nova.compute.manager [req-bfd34c1d-502f-4eb5-a191-08f9e2e9e676 req-7578c7bc-7416-431a-a11f-f07ab24a8d88 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:18:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-7e63cd81-8fe8-45e9-9f53-d6728948ad29 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:18:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:35 user nova-compute[74534]: INFO nova.compute.manager [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Detaching volume 38b35512-2c64-41f8-b40a-0f9bc049ae2f
Nov 02 12:18:35 user nova-compute[74534]: INFO nova.virt.block_device [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Attempting to driver detach volume 38b35512-2c64-41f8-b40a-0f9bc049ae2f from mountpoint /dev/vdb
Nov 02 12:18:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Attempting to detach device vdb from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:18:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:18:35 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:18:35 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:18:35 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:18:35 user nova-compute[74534]:   <serial>38b35512-2c64-41f8-b40a-0f9bc049ae2f</serial>
Nov 02 12:18:35 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:18:35 user nova-compute[74534]: </disk>
Nov 02 12:18:35 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:18:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Successfully detached device vdb from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the persistent domain config.
Nov 02 12:18:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:18:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:18:35 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:18:35 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:18:35 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:18:35 user nova-compute[74534]:   <serial>38b35512-2c64-41f8-b40a-0f9bc049ae2f</serial>
Nov 02 12:18:35 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:18:35 user nova-compute[74534]: </disk>
Nov 02 12:18:35 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:18:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:18:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeLcBzav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:18:50 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:18:50 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:18:50 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3de189a-c303-4916-91c4-34378fa066ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:18:50 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcdad28-d933-4301-a584-3854f3280d91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63] added
Nov 02 12:18:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[00355105-4a82-493d-bfbe-27465a961adb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71cb7cc-cda0-49e2-ad86-82eb416c23c1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeLcBzav {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeLcBzav" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8da97c4-500b-413e-90d7-dd3b1d775d15]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EeLcBzav'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e276f23-d44b-4e3f-bc9e-0210c5c55817]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad11b8bf-8f2e-40b3-9e24-1624caf94783]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1637d4-b164-4b32-a11c-2133ee1e5609]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260]
Nov 02 12:18:50 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260] successful.
Nov 02 12:18:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[962cc5bd-6329-406d-ba7e-7ba2bcc3ca86]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf5402d-b4f6-4b46-8648-eeb6746d49f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[616ce774-5ef6-4fdb-99df-649e385755cd]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:18:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeLcBzav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23264643463366164', 'path': '/dev/sdf'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264643463366164', 'path': '/dev/sdf'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG nova.objects.instance [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid af8aed6f-de40-47e9-a777-0122aac6e29c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:18:51 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:18:51 user nova-compute[74534]:   <source dev="/dev/sdf"/>
Nov 02 12:18:51 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:18:51 user nova-compute[74534]:   <serial>26430f6a-72b8-4f44-9015-d01e008e5e63</serial>
Nov 02 12:18:51 user nova-compute[74534]: </disk>
Nov 02 12:18:51 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:18:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] No VIF found with MAC fa:16:3e:c5:c6:82, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:18:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02d18e10-3f64-471d-9195-e5d1ee30169d tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.792s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:53 user nova-compute[74534]: INFO nova.compute.manager [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Detaching volume 26430f6a-72b8-4f44-9015-d01e008e5e63
Nov 02 12:18:53 user nova-compute[74534]: INFO nova.virt.block_device [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Attempting to driver detach volume 26430f6a-72b8-4f44-9015-d01e008e5e63 from mountpoint /dev/vdb
Nov 02 12:18:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Attempting to detach device vdb from instance af8aed6f-de40-47e9-a777-0122aac6e29c from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:18:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:18:53 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:18:53 user nova-compute[74534]:   <source dev="/dev/sdf"/>
Nov 02 12:18:53 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:18:53 user nova-compute[74534]:   <serial>26430f6a-72b8-4f44-9015-d01e008e5e63</serial>
Nov 02 12:18:53 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:18:53 user nova-compute[74534]: </disk>
Nov 02 12:18:53 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:18:53 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully detached device vdb from instance af8aed6f-de40-47e9-a777-0122aac6e29c from the persistent domain config.
Nov 02 12:18:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af8aed6f-de40-47e9-a777-0122aac6e29c from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:18:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:18:53 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:18:53 user nova-compute[74534]:   <source dev="/dev/sdf"/>
Nov 02 12:18:53 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:18:53 user nova-compute[74534]:   <serial>26430f6a-72b8-4f44-9015-d01e008e5e63</serial>
Nov 02 12:18:53 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:18:53 user nova-compute[74534]: </disk>
Nov 02 12:18:53 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:18:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af8aed6f-de40-47e9-a777-0122aac6e29c {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:18:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldmQFLDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:18:54 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:18:54 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:18:54 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5d27e-498c-4f91-b9bf-b537dcb79e00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:18:54 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c1874-70bb-49bb-9df6-d11cbe2a6c95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2] added
Nov 02 12:18:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19a6a5-d425-4e04-8fcb-50f7727f8b29]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f61805-003c-4531-86e2-8da045fe3e18]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ldmQFLDU {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ldmQFLDU" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe4d9e-018b-490b-b996-2b13dadaaf4c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ldmQFLDU'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efa46d4-6bbd-486f-bd7c-40d317daf103]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1f1e29-7d89-4a96-9db5-5633bb45021b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b71221-334a-4bb0-9180-529972de815f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260]
Nov 02 12:18:54 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260] successful.
Nov 02 12:18:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4097cc94-2a02-4994-8c26-6bd905ce4896]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e568e6da-e78b-488f-8df4-9e5a3d045849]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:18:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f5d88-1024-4109-a6c2-5e785de3d9f3]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldmQFLDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26135366538343533', 'path': '/dev/sdg'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135366538343533', 'path': '/dev/sdg'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG nova.objects.instance [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:18:55 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:18:55 user nova-compute[74534]:   <source dev="/dev/sdg"/>
Nov 02 12:18:55 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:18:55 user nova-compute[74534]:   <serial>c63f913f-63ef-4f50-8232-d41d2f0919f2</serial>
Nov 02 12:18:55 user nova-compute[74534]: </disk>
Nov 02 12:18:55 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:18:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No VIF found with MAC fa:16:3e:70:85:c5, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-70115e6c-4882-480f-a9e3-01e2a5be6472 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.592s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:18:56 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff is timed out.
Nov 02 12:18:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Successfully detached device vdb from instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff from the live domain config.
Nov 02 12:18:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNehTLkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:18:56 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[943061f2-851e-499d-9f94-55a73d8b70a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:18:56 user nova-compute[74534]: No targets found.
Nov 02 12:18:56 user nova-compute[74534]: iSNS:
Nov 02 12:18:56 user nova-compute[74534]: No targets found.
Nov 02 12:18:56 user nova-compute[74534]: STATIC:
Nov 02 12:18:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:18:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63
Nov 02 12:18:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2
Nov 02 12:18:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:18:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f
Nov 02 12:18:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:18:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:18:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:18:56 user nova-compute[74534]: FIRMWARE:
Nov 02 12:18:56 user nova-compute[74534]: No targets found.
Nov 02 12:18:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:18:56 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:18:56 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfcd680-178f-489d-960e-f94f39f15bce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ce8266-de64-4a32-92c7-82d7b753455e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:18:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe198279c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8b6034-72d4-43e1-81c1-c858cf1d092a]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd637b1-7866-4907-90ce-a98d38bfae3b]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0bc3ac-0c4d-4dce-a7bc-523d0bd4ce1d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc118f1-a9f0-4ded-97b6-1319922028e3]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec52939-4559-43f3-943b-61aeec71be68]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd4204-1dca-4566-910d-1efe6f3b4ef1]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260]
Nov 02 12:18:56 user nova-compute[74534]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f, portal: 172.16.0.220,3260] successful.
Nov 02 12:18:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b35512-2c64-41f8-b40a-0f9bc049ae2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8225b435-9723-4af5-8296-afcb8a6d0ec8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] <== disconnect_volume: return (400ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-changed-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Refreshing instance network info cache due to event network-changed-eeff8901-03cf-47f3-b6ef-27d1abc1479a. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] Acquiring lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] Acquired lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:18:56 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Refreshing network info cache for port eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:18:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updated VIF entry in instance network info cache for port eeff8901-03cf-47f3-b6ef-27d1abc1479a. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:18:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:18:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4ee3699-a261-4efb-b5fb-34837543dd11 req-3a7fb202-fe3a-4c02-b92d-2ad2e4d5d6b5 service nova] Releasing lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:18:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-changed-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Refreshing instance network info cache due to event network-changed-9ce301a6-44ca-4ef0-81ce-3fa446504903. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] Acquiring lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] Acquired lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Refreshing network info cache for port 9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Stashing vm_state: active {{(pid=74534) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updated VIF entry in instance network info cache for port 9ce301a6-44ca-4ef0-81ce-3fa446504903. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating instance_info_cache with network_info: [{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a817ae48-0598-4826-a7fb-b5a1b0e55781 req-6c9a46e2-b1e6-49c4-9201-b8c16cf832df service nova] Releasing lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:18:59 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:18:59 user nova-compute[74534]: INFO nova.compute.claims [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Claim successful on node user
Nov 02 12:18:59 user nova-compute[74534]: INFO nova.compute.resource_tracker [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating resource usage from migration b790b8d9-e290-4287-8c60-97c98c4baa33
Nov 02 12:19:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:00 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:19:00 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:19:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.706s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:00 user nova-compute[74534]: INFO nova.compute.manager [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Migrating
Nov 02 12:19:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquired lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:19:00 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating instance_info_cache with network_info: [{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Releasing lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Starting migrate_disk_and_power_off {{(pid=74534) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-86237be9-4a2c-40dd-ba57-25e02d9dbabc req-41176b4d-7d12-42be-9a1a-7791916da72a service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-unplugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-86237be9-4a2c-40dd-ba57-25e02d9dbabc req-41176b4d-7d12-42be-9a1a-7791916da72a service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-86237be9-4a2c-40dd-ba57-25e02d9dbabc req-41176b4d-7d12-42be-9a1a-7791916da72a service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-86237be9-4a2c-40dd-ba57-25e02d9dbabc req-41176b4d-7d12-42be-9a1a-7791916da72a service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-86237be9-4a2c-40dd-ba57-25e02d9dbabc req-41176b4d-7d12-42be-9a1a-7791916da72a service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-unplugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:01 user nova-compute[74534]: WARNING nova.compute.manager [req-86237be9-4a2c-40dd-ba57-25e02d9dbabc req-41176b4d-7d12-42be-9a1a-7791916da72a service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received unexpected event network-vif-unplugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with vm_state active and task_state resize_migrating.
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance destroyed successfully.
Nov 02 12:19:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344270638',display_name='tempest-ServerActionsTestOtherA-server-1344270638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344270638',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:17:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-dn1kg9xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=b7864c94-0468-459b-9f5e-86e85c28efed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2115201477-network", "vif_mac": "fa:16:3e:21:4c:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2115201477-network", "vif_mac": "fa:16:3e:21:4c:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG os_vif [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ce301a6-44, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e489729-97d9-4db6-b935-a18254e6cf60) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:01 user nova-compute[74534]: INFO os_vif [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44')
Nov 02 12:19:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:01 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d5352b-80cb-48ed-9111-3012d173a48f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:19:02 user nova-compute[74534]: No targets found.
Nov 02 12:19:02 user nova-compute[74534]: iSNS:
Nov 02 12:19:02 user nova-compute[74534]: No targets found.
Nov 02 12:19:02 user nova-compute[74534]: STATIC:
Nov 02 12:19:02 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:19:02 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:02 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:02 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63
Nov 02 12:19:02 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:02 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:02 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2
Nov 02 12:19:02 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:02 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:02 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:19:02 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:02 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:02 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:19:02 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:02 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:02 user nova-compute[74534]: FIRMWARE:
Nov 02 12:19:02 user nova-compute[74534]: No targets found.
Nov 02 12:19:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:19:02 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:19:02 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d859d1bf-f430-4c61-ab33-04093c70ae6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62098f2-f9e2-4631-82cd-3b76039f9871]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180522320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1'): ({'sde'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Removing single pathed devices sde {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9fee91-edb7-4986-b262-6778f1306b70]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17d56ff-2d85-4f88-b0df-bfc838e169ae]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flushing IO for device /dev/sde {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb752c74-eec9-420f-a998-e4d35acaed30]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.098s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a26ff19-ed46-4134-816a-1d12c207513e]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a953e4-08f5-42b6-8a3f-65c30b69fd76]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77b709d-1c1e-49c2-81df-68d26f604343]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]
Nov 02 12:19:02 user nova-compute[74534]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.
Nov 02 12:19:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56d67c-0f1f-4b05-910e-981534d34f81]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== disconnect_volume: return (435ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG nova.objects.instance [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'flavor' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-84dde1df-dea4-4ccf-993e-05f9fba9a343 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.031s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-8f71fad7-2a94-4f36-a72d-221df38e1e73 req-b43bb45f-f8d6-4bc8-bd6c-1067f8739ac8 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f71fad7-2a94-4f36-a72d-221df38e1e73 req-b43bb45f-f8d6-4bc8-bd6c-1067f8739ac8 service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f71fad7-2a94-4f36-a72d-221df38e1e73 req-b43bb45f-f8d6-4bc8-bd6c-1067f8739ac8 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8f71fad7-2a94-4f36-a72d-221df38e1e73 req-b43bb45f-f8d6-4bc8-bd6c-1067f8739ac8 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-8f71fad7-2a94-4f36-a72d-221df38e1e73 req-b43bb45f-f8d6-4bc8-bd6c-1067f8739ac8 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:03 user nova-compute[74534]: WARNING nova.compute.manager [req-8f71fad7-2a94-4f36-a72d-221df38e1e73 req-b43bb45f-f8d6-4bc8-bd6c-1067f8739ac8 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received unexpected event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with vm_state active and task_state resize_migrating.
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG nova.objects.instance [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:04 user nova-compute[74534]: INFO nova.compute.manager [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Attaching volume 011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 to /dev/vdc
Nov 02 12:19:04 user nova-compute[74534]: DEBUG os_brick.utils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe92363-c9f1-439a-854a-4d2c44cdfae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f65ba2b-4e84-40b6-810c-184367010bdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e367f880-699b-4b9c-b7b8-b4195c54f252]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f7e16d-0130-4893-a8ae-f3e464570857]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:04 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:19:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f428cd-db98-408c-890b-7457a099d755]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG os_brick.utils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:04 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updating existing volume attachment record: 8d6d49d2-2d30-46b2-b654-16943cf03eea {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:19:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:19:06 user nova-compute[74534]: INFO nova.compute.claims [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Claim successful on node user
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:19:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:19:07 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:19:07 user nova-compute[74534]: INFO nova.virt.block_device [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Booting with volume 4fdbf051-f126-4797-a91b-cb37db875389 at /dev/vda
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.policy [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a4693f7b5e54a778c51c45228b31d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844db01d167242c7ae0336faefedc180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG os_brick.utils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[232830ab-6d77-4155-b8e2-c659a3b55e30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf481a3-e704-4913-b684-0b1c4fc286d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc0f9b4-f24a-43f1-851d-9fc75b45d167]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb7a0d6-16c1-428b-b8f8-a8fd64011619]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:07 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c949a8d9-adbc-4a98-80d4-6182d836889b]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG os_brick.utils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating existing volume attachment record: b3f95ea7-aa68-4b92-b3ed-7740c93679d2 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully created port: 0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully created port: 908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully created port: c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:19:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully created port: 5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully created port: 088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully updated port: 0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-0ee2046c-a1c2-4037-8d1b-377dd57da458. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port 0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0992346e-9e92-4082-9c42-9815458c5444 req-94bf738e-0dc2-4f8f-ac4b-336acc851e3f service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully updated port: 63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:19:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:19:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7330MB free_disk=25.025287628173828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Applying migration context for instance b7864c94-0468-459b-9f5e-86e85c28efed as it has an incoming, in-progress migration b790b8d9-e290-4287-8c60-97c98c4baa33. Migration status is migrating {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 12:19:12 user nova-compute[74534]: INFO nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating resource usage from migration b790b8d9-e290-4287-8c60-97c98c4baa33
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 868612a8-7a46-400e-add0-4eb7374ca056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance af8aed6f-de40-47e9-a777-0122aac6e29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 851d34d6-c9f0-4db3-8e3b-5e31eba77479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Migration b790b8d9-e290-4287-8c60-97c98c4baa33 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:19:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully updated port: a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-63c57fd1-3980-43a5-8543-8c05d7af97cd. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port 63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:19:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af8aed6f-de40-47e9-a777-0122aac6e29c is timed out.
Nov 02 12:19:13 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully detached device vdb from instance af8aed6f-de40-47e9-a777-0122aac6e29c from the live domain config.
Nov 02 12:19:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeLcBzav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:13 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c644722-bf3c-4dad-8422-6ceacc8c9373]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:19:13 user nova-compute[74534]: No targets found.
Nov 02 12:19:13 user nova-compute[74534]: iSNS:
Nov 02 12:19:13 user nova-compute[74534]: No targets found.
Nov 02 12:19:13 user nova-compute[74534]: STATIC:
Nov 02 12:19:13 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:19:13 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:13 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:13 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63
Nov 02 12:19:13 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:13 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:13 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2
Nov 02 12:19:13 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:13 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:13 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:19:13 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:13 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:13 user nova-compute[74534]: FIRMWARE:
Nov 02 12:19:13 user nova-compute[74534]: No targets found.
Nov 02 12:19:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:19:13 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:19:13 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13e6697-2477-4a77-88ea-98f52803d76e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b19522-1263-400e-8372-1aef272b43ca]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:13 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:13 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:19:13 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:13 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:13 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:13 user nova-compute[74534]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 (non-flash)
Nov 02 12:19:13 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:13 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1807ca950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63'): ({'sdf'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Removing single pathed devices sdf {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-a90c6ff2-2c7c-4769-be62-9273d12c46cd. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e5d352-bb4f-4656-8952-cc8516388d1f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[69192054-9dcd-4785-bba9-cf205a47ca45]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Flushing IO for device /dev/sdf {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afaeb83-8b2f-486f-aa3e-5c22e7ce0d00]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Port 9ce301a6-44ca-4ef0-81ce-3fa446504903 binding to destination host user is already ACTIVE {{(pid=74534) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7188c74b-53f1-46dd-af03-deb720f6eebe]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[193572b1-c760-4ad0-a9e9-b1f75e3d7302]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2585aa76-3839-4410-a121-084c07c862c9]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260]
Nov 02 12:19:14 user nova-compute[74534]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63, portal: 172.16.0.220,3260] successful.
Nov 02 12:19:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26430f6a-72b8-4f44-9015-d01e008e5e63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0758159-90ae-4739-ac22-1cbb3bd0b742]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] <== disconnect_volume: return (461ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:19:14 user nova-compute[74534]: INFO nova.compute.manager [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Rescuing
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully updated port: 908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquired lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9030808e-f2ab-4745-968c-1016a35cceed req-cb806aa5-2a70-4a01-b69b-564b7f9be1c2 service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating instance_info_cache with network_info: [{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG nova.network.neutron [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updating instance_info_cache with network_info: [{"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Releasing lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG os_brick.utils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34cf0f-3ddd-4e72-b5c8-d63c87bd359a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[810b5ba5-5b76-446f-bca4-6568e1d54a3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ef0850-de78-45f9-88a0-13690dc1442a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5280e8-a14a-4b36-a7fb-51112703a147]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:15 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d29ca9-6274-4524-8bcc-ccbaac1096f2]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG os_brick.utils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-908d040c-f503-44c6-b52d-4a52152d86d9. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port 908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:19:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance destroyed successfully.
Nov 02 12:19:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Attempting a stable device rescue
Nov 02 12:19:16 user nova-compute[74534]: DEBUG nova.network.neutron [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74534) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ef9fb67d-678c-43a0-a734-0cbbe077310b req-e70533fa-6efc-4802-95de-35543ae4456d service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance directory exists: not creating {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 12:19:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Creating image(s)
Nov 02 12:19:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "/opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "e2b5b0136495b41d5d95b20b88620981c7735312" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "e2b5b0136495b41d5d95b20b88620981c7735312" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully updated port: c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:17 user nova-compute[74534]: WARNING nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state active and task_state rescuing.
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:17 user nova-compute[74534]: WARNING nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state active and task_state rescuing.
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-c3a06949-5196-4ffa-9cf9-448b251059d3. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:17 user nova-compute[74534]: DEBUG nova.network.neutron [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.part --force-share --output=json" returned: 0 in 0.218s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG nova.virt.images [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] 19ecc585-c82f-4aec-9046-42d7b450bdf7 was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.part /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e95185b9-cc53-4a95-a41f-a1f5355b9fc2 req-979ab4c4-6bd4-4f79-a342-d4ee3935f605 service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.part /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.converted" returned: 0 in 0.595s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully updated port: 5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "e2b5b0136495b41d5d95b20b88620981c7735312" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.528s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "e2b5b0136495b41d5d95b20b88620981c7735312" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "e2b5b0136495b41d5d95b20b88620981c7735312" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312 --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312,backing_fmt=raw /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.rescue {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312,backing_fmt=raw /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.rescue" returned: 0 in 0.052s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "e2b5b0136495b41d5d95b20b88620981c7735312" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'migration_context' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<1dd3521d-944a-4d86-bcf5-d5988b6f923c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Start _get_guest_xml network_info=[{"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "vif_mac": "fa:16:3e:04:cc:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '19ecc585-c82f-4aec-9046-42d7b450bdf7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e9e4ead8-742e-4943-98e3-5e1b87213420', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuTgXEUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1dd3521d-944a-4d86-bcf5-d5988b6f923c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6225913-83b4-42e7-90cd-57cdab9676bb', 'serial': 'd6225913-83b4-42e7-90cd-57cdab9676bb'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'resources' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<1dd3521d-944a-4d86-bcf5-d5988b6f923c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'numa_topology' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<1dd3521d-944a-4d86-bcf5-d5988b6f923c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:19:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:19:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<1dd3521d-944a-4d86-bcf5-d5988b6f923c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuTgXEUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:19 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:19 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:19 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7bdd56-5915-4073-bdc1-e4ef3f934d82]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HuTgXEUc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 12:19:19 user nova-compute[74534]: node.name = iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:19:19 user nova-compute[74534]: node.tpgt = -1
Nov 02 12:19:19 user nova-compute[74534]: node.startup = automatic
Nov 02 12:19:19 user nova-compute[74534]: node.leading_login = No
Nov 02 12:19:19 user nova-compute[74534]: iface.iscsi_ifacename = default
Nov 02 12:19:19 user nova-compute[74534]: iface.net_ifacename = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.ipaddress = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.prefix_len = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.hwaddress = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.transport_name = tcp
Nov 02 12:19:19 user nova-compute[74534]: iface.initiatorname = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.state = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.vlan_id = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.vlan_priority = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.vlan_state = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.iface_num = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.mtu = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.port = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.bootproto = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.subnet_mask = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.gateway = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_alt_client_id = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_dns = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_learn_iqn = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_vendor_id_state = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_vendor_id = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.dhcp_slp_da = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.fragmentation = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.gratuitous_arp = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.incoming_forwarding = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.tos_state = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.tos = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.ttl = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.delayed_ack = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.tcp_nagle = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.tcp_wsf_state = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.tcp_wsf = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.tcp_timer_scale = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.tcp_timestamp = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.redirect = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.def_task_mgmt_timeout = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.header_digest = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.data_digest = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.immediate_data = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.initial_r2t = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.data_seq_inorder = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.data_pdu_inorder = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.erl = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.max_receive_data_len = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.first_burst_len = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.max_outstanding_r2t = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.max_burst_len = 0
Nov 02 12:19:19 user nova-compute[74534]: iface.chap_auth = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.bidi_chap = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.strict_login_compliance = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.discovery_auth = <empty>
Nov 02 12:19:19 user nova-compute[74534]: iface.discovery_logout = <empty>
Nov 02 12:19:19 user nova-compute[74534]: node.discovery_address = <empty>
Nov 02 12:19:19 user nova-compute[74534]: node.discovery_port = 0
Nov 02 12:19:19 user nova-compute[74534]: node.discovery_type = static
Nov 02 12:19:19 user nova-compute[74534]: node.session.initial_cmdsn = 0
Nov 02 12:19:19 user nova-compute[74534]: node.session.initial_login_retry_max = 8
Nov 02 12:19:19 user nova-compute[74534]: node.session.xmit_thread_priority = -20
Nov 02 12:19:19 user nova-compute[74534]: node.session.cmds_max = 128
Nov 02 12:19:19 user nova-compute[74534]: node.session.queue_depth = 32
Nov 02 12:19:19 user nova-compute[74534]: node.session.nr_sessions = 1
Nov 02 12:19:19 user nova-compute[74534]: node.session.auth.authmethod = CHAP
Nov 02 12:19:19 user nova-compute[74534]: node.session.auth.username = HuTgXEUc
Nov 02 12:19:19 user nova-compute[74534]: node.session.auth.password = ***
Nov 02 12:19:19 user nova-compute[74534]: node.session.auth.username_in = <empty>
Nov 02 12:19:19 user nova-compute[74534]: node.session.auth.password_in = <empty>
Nov 02 12:19:19 user nova-compute[74534]: node.session.auth.chap_algs = MD5
Nov 02 12:19:19 user nova-compute[74534]: node.session.timeo.replacement_timeout = 120
Nov 02 12:19:19 user nova-compute[74534]: node.session.err_timeo.abort_timeout = 15
Nov 02 12:19:19 user nova-compute[74534]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 12:19:19 user nova-compute[74534]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 12:19:19 user nova-compute[74534]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.FastAbort = Yes
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.InitialR2T = No
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.ImmediateData = Yes
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.MaxConnections = 1
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 12:19:19 user nova-compute[74534]: node.session.iscsi.ERL = 0
Nov 02 12:19:19 user nova-compute[74534]: node.session.scan = manual
Nov 02 12:19:19 user nova-compute[74534]: node.session.reopen_max = 0
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].address = 172.16.0.220
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].port = 3260
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].startup = manual
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].tcp.window_size = 524288
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].tcp.type_of_service = 0
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].timeo.logout_timeout = 15
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].timeo.login_timeout = 15
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].timeo.auth_timeout = 45
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].iscsi.DataDigest = None
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].iscsi.IFMarker = No
Nov 02 12:19:19 user nova-compute[74534]: node.conn[0].iscsi.OFMarker = No
Nov 02 12:19:19 user nova-compute[74534]: # END RECORD
Nov 02 12:19:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0b1418-5299-4ca2-a415-62c421e51976]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2d162-39dc-4e6a-985c-9db1e4766b19]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuTgXEUc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuTgXEUc" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e78e76-9e5f-43d1-85d2-aae463213788]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuTgXEUc'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ae11d-4010-42ac-9111-f307e4ab7c68]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Successfully updated port: 088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8af1a-8b7e-45c8-8b92-ac18762824bc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:19 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:19 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:19 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:19 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] HCTL ('34', '0', '0', 0) found on session 27 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b528da-f0cf-4320-aa69-85cd58a4f388]: (4, ('0 0 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Searching for a device in session 27 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuTgXEUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '26461663936313964', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461663936313964', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2052723514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2052723514',id=30,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-bg38yprw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:17:33Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=1dd3521d-944a-4d86-bcf5-d5988b6f923c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "vif_mac": "fa:16:3e:04:cc:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "vif_mac": "fa:16:3e:04:cc:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.objects.base [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Object Instance<1dd3521d-944a-4d86-bcf5-d5988b6f923c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:19:19 user nova-compute[74534]:   <uuid>1dd3521d-944a-4d86-bcf5-d5988b6f923c</uuid>
Nov 02 12:19:19 user nova-compute[74534]:   <name>instance-0000001e</name>
Nov 02 12:19:19 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:19:19 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:19:19 user nova-compute[74534]:   <metadata>
Nov 02 12:19:19 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:19:19 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:19:19 user nova-compute[74534]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2052723514</nova:name>
Nov 02 12:19:19 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:19:19</nova:creationTime>
Nov 02 12:19:19 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:19:19 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:19:19 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:19:19 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:19:19 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:19:19 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:19:19 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:19:19 user nova-compute[74534]:       <nova:owner>
Nov 02 12:19:19 user nova-compute[74534]:         <nova:user uuid="caf5cde0e75e444da00c7bcda4bcdd28">tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member</nova:user>
Nov 02 12:19:19 user nova-compute[74534]:         <nova:project uuid="25ccb20fcd184ecebd3707d9d93c8817">tempest-ServerBootFromVolumeStableRescueTest-1363504210</nova:project>
Nov 02 12:19:19 user nova-compute[74534]:       </nova:owner>
Nov 02 12:19:19 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:19:19 user nova-compute[74534]:       <nova:ports>
Nov 02 12:19:19 user nova-compute[74534]:         <nova:port uuid="dc473798-99ef-4267-9840-e445a25d7322">
Nov 02 12:19:19 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:19:19 user nova-compute[74534]:         </nova:port>
Nov 02 12:19:19 user nova-compute[74534]:       </nova:ports>
Nov 02 12:19:19 user nova-compute[74534]:     </nova:instance>
Nov 02 12:19:19 user nova-compute[74534]:   </metadata>
Nov 02 12:19:19 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:19:19 user nova-compute[74534]:     <system>
Nov 02 12:19:19 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:19:19 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:19:19 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:19:19 user nova-compute[74534]:       <entry name="serial">1dd3521d-944a-4d86-bcf5-d5988b6f923c</entry>
Nov 02 12:19:19 user nova-compute[74534]:       <entry name="uuid">1dd3521d-944a-4d86-bcf5-d5988b6f923c</entry>
Nov 02 12:19:19 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:19:19 user nova-compute[74534]:     </system>
Nov 02 12:19:19 user nova-compute[74534]:   </sysinfo>
Nov 02 12:19:19 user nova-compute[74534]:   <os>
Nov 02 12:19:19 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:19:19 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:19:19 user nova-compute[74534]:   </os>
Nov 02 12:19:19 user nova-compute[74534]:   <features>
Nov 02 12:19:19 user nova-compute[74534]:     <acpi/>
Nov 02 12:19:19 user nova-compute[74534]:     <apic/>
Nov 02 12:19:19 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:19:19 user nova-compute[74534]:   </features>
Nov 02 12:19:19 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:19:19 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:19:19 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:19:19 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:19:19 user nova-compute[74534]:   </clock>
Nov 02 12:19:19 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:19:19 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:19:19 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:19:19 user nova-compute[74534]:   </cpu>
Nov 02 12:19:19 user nova-compute[74534]:   <devices>
Nov 02 12:19:19 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:19:19 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:19:19 user nova-compute[74534]:       <source dev="/dev/sdc"/>
Nov 02 12:19:19 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:19:19 user nova-compute[74534]:       <serial>d6225913-83b4-42e7-90cd-57cdab9676bb</serial>
Nov 02 12:19:19 user nova-compute[74534]:     </disk>
Nov 02 12:19:19 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:19:19 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:19:19 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.rescue"/>
Nov 02 12:19:19 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:19:19 user nova-compute[74534]:       <boot order="1"/>
Nov 02 12:19:19 user nova-compute[74534]:     </disk>
Nov 02 12:19:19 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:19:19 user nova-compute[74534]:       <mac address="fa:16:3e:04:cc:52"/>
Nov 02 12:19:19 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:19:19 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:19:19 user nova-compute[74534]:       <target dev="tapdc473798-99"/>
Nov 02 12:19:19 user nova-compute[74534]:     </interface>
Nov 02 12:19:19 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:19:19 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/console.log" append="off"/>
Nov 02 12:19:19 user nova-compute[74534]:     </serial>
Nov 02 12:19:19 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:19:19 user nova-compute[74534]:     <video>
Nov 02 12:19:19 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:19:19 user nova-compute[74534]:     </video>
Nov 02 12:19:19 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:19:19 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:19:19 user nova-compute[74534]:     </rng>
Nov 02 12:19:19 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:19:19 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:19:19 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:19:19 user nova-compute[74534]:     </memballoon>
Nov 02 12:19:19 user nova-compute[74534]:   </devices>
Nov 02 12:19:19 user nova-compute[74534]: </domain>
Nov 02 12:19:19 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:19:19 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance destroyed successfully.
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] No VIF found with MAC fa:16:3e:04:cc:52, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:19:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:20 user nova-compute[74534]: DEBUG nova.objects.instance [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'flavor' on Instance uuid af8aed6f-de40-47e9-a777-0122aac6e29c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c7cd605c-11d4-46db-a631-21388db94b71 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.588s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:21 user nova-compute[74534]: INFO nova.compute.manager [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Terminating instance
Nov 02 12:19:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-eadfd201-835e-40b1-a2b5-1e9ddd4ad8c9 req-b9f834ce-4770-47c4-8656-afb8750d75f6 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eadfd201-835e-40b1-a2b5-1e9ddd4ad8c9 req-b9f834ce-4770-47c4-8656-afb8750d75f6 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eadfd201-835e-40b1-a2b5-1e9ddd4ad8c9 req-b9f834ce-4770-47c4-8656-afb8750d75f6 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eadfd201-835e-40b1-a2b5-1e9ddd4ad8c9 req-b9f834ce-4770-47c4-8656-afb8750d75f6 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-eadfd201-835e-40b1-a2b5-1e9ddd4ad8c9 req-b9f834ce-4770-47c4-8656-afb8750d75f6 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:21 user nova-compute[74534]: WARNING nova.compute.manager [req-eadfd201-835e-40b1-a2b5-1e9ddd4ad8c9 req-b9f834ce-4770-47c4-8656-afb8750d75f6 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state active and task_state rescuing.
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Instance destroyed successfully.
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.objects.instance [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lazy-loading 'resources' on Instance uuid 851d34d6-c9f0-4db3-8e3b-5e31eba77479 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-954059505',display_name='tempest-VolumesActionsTest-instance-954059505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-954059505',id=32,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:17:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cc76741e7745b5a49b4c7ee2a8c441',ramdisk_id='',reservation_id='r-15pvwz2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1016251624',owner_user_name='tempest-VolumesActionsTest-1016251624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:17:18Z,user_data=None,user_id='e713bb115ec8416ab1f2a51a93051233',uuid=851d34d6-c9f0-4db3-8e3b-5e31eba77479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Converting VIF {"id": "b5750788-98de-44ce-9e0d-5aabea596de0", "address": "fa:16:3e:ca:ed:89", "network": {"id": "301a023c-87d9-4d23-bd67-019e4de327b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-224437106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cc76741e7745b5a49b4c7ee2a8c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5750788-98", "ovs_interfaceid": "b5750788-98de-44ce-9e0d-5aabea596de0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:89,bridge_name='br-int',has_traffic_filtering=True,id=b5750788-98de-44ce-9e0d-5aabea596de0,network=Network(301a023c-87d9-4d23-bd67-019e4de327b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5750788-98') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG os_vif [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:89,bridge_name='br-int',has_traffic_filtering=True,id=b5750788-98de-44ce-9e0d-5aabea596de0,network=Network(301a023c-87d9-4d23-bd67-019e4de327b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5750788-98') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance network_info: |[{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port 5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5750788-98, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=260d2311-c075-4d89-bae8-7f0e16fc6210) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:22 user nova-compute[74534]: INFO os_vif [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:89,bridge_name='br-int',has_traffic_filtering=True,id=b5750788-98de-44ce-9e0d-5aabea596de0,network=Network(301a023c-87d9-4d23-bd67-019e4de327b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5750788-98')
Nov 02 12:19:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Deleting instance files /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479_del
Nov 02 12:19:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Deletion of /opt/stack/data/nova/instances/851d34d6-c9f0-4db3-8e3b-5e31eba77479_del complete
Nov 02 12:19:22 user nova-compute[74534]: INFO nova.compute.manager [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 02 12:19:22 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:19:22 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updated VIF entry in instance network info cache for port 5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-088b5ee3-9557-4697-8015-042bd42946d1. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port 088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:23 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Took 0.79 seconds to deallocate network for instance.
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-21e0e581-b7c4-4c53-8672-73f740657d7e req-4f1f9caa-5b69-4018-b464-14ff5ed70413 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received event network-vif-deleted-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:23 user nova-compute[74534]: INFO nova.compute.manager [req-21e0e581-b7c4-4c53-8672-73f740657d7e req-4f1f9caa-5b69-4018-b464-14ff5ed70413 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Neutron deleted interface b5750788-98de-44ce-9e0d-5aabea596de0; detaching it from the instance and deleting it from the info cache
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-21e0e581-b7c4-4c53-8672-73f740657d7e req-4f1f9caa-5b69-4018-b464-14ff5ed70413 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-21e0e581-b7c4-4c53-8672-73f740657d7e req-4f1f9caa-5b69-4018-b464-14ff5ed70413 service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Detach interface failed, port_id=b5750788-98de-44ce-9e0d-5aabea596de0, reason: Instance 851d34d6-c9f0-4db3-8e3b-5e31eba77479 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updated VIF entry in instance network info cache for port 088b5ee3-9557-4697-8015-042bd42946d1. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4260204a-e1ac-45f4-b7c4-506c4b693f98 req-22bf16cd-a8d3-493e-ae92-38f511c165c2 service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-7602db73-4ab2-479d-a85b-33ddfe30379d tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:19:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:24 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Deleted allocations for instance 851d34d6-c9f0-4db3-8e3b-5e31eba77479
Nov 02 12:19:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:24 user nova-compute[74534]: WARNING nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state rescued and task_state None.
Nov 02 12:19:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received event network-vif-unplugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Acquiring lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] No waiting events found dispatching network-vif-unplugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:24 user nova-compute[74534]: WARNING nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received unexpected event network-vif-unplugged-b5750788-98de-44ce-9e0d-5aabea596de0 for instance with vm_state deleted and task_state None.
Nov 02 12:19:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received event network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Acquiring lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:24 user nova-compute[74534]: DEBUG nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] No waiting events found dispatching network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:24 user nova-compute[74534]: WARNING nova.compute.manager [req-c6eaae69-4fb3-4996-a30a-103ede99f280 req-f2a29078-cbfa-4de3-b5c8-04573f11129e service nova] [instance: 851d34d6-c9f0-4db3-8e3b-5e31eba77479] Received unexpected event network-vif-plugged-b5750788-98de-44ce-9e0d-5aabea596de0 for instance with vm_state deleted and task_state None.
Nov 02 12:19:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-00658de0-b23e-41d7-b9f8-19c7db48ca43 tempest-VolumesActionsTest-1016251624 tempest-VolumesActionsTest-1016251624-project-member] Lock "851d34d6-c9f0-4db3-8e3b-5e31eba77479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.714s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSQOEWxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:29 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:29 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:29 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[964dfc1e-ab0b-41b7-af7f-e79891e992d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:19:29 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f3eff9-9c55-4861-a631-336bf71a2e77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2] added
Nov 02 12:19:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c6283-7af1-40e6-a10e-c714d06a66e6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cbdbb1-b40d-4ac8-a8cd-f7d9c80d1680]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zSQOEWxN {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zSQOEWxN" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59f5af2-cbea-4920-a2e2-35a7164e8bbe]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zSQOEWxN'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f47aa-1694-450b-bb9d-d80202b0ad43]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4897c3-5c3a-4f37-b3d4-77b1d75538ea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb47106c-9883-449c-a085-07806665fc04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260]
Nov 02 12:19:30 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260] successful.
Nov 02 12:19:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a9f131-280d-41cc-90b1-ae2db757f079]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e7692f-926b-4d23-8d97-75a6e5a60c3d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2369d09d-cd3f-499f-b736-04b744f73909]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSQOEWxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:30 user nova-compute[74534]: INFO nova.compute.manager [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Terminating instance
Nov 02 12:19:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-3efa608a-e657-40c2-8a74-73bd0e76b2a8 req-cb5af8ab-f4fc-4f44-9ad6-fe12831adf41 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-vif-unplugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3efa608a-e657-40c2-8a74-73bd0e76b2a8 req-cb5af8ab-f4fc-4f44-9ad6-fe12831adf41 service nova] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3efa608a-e657-40c2-8a74-73bd0e76b2a8 req-cb5af8ab-f4fc-4f44-9ad6-fe12831adf41 service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3efa608a-e657-40c2-8a74-73bd0e76b2a8 req-cb5af8ab-f4fc-4f44-9ad6-fe12831adf41 service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-3efa608a-e657-40c2-8a74-73bd0e76b2a8 req-cb5af8ab-f4fc-4f44-9ad6-fe12831adf41 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] No waiting events found dispatching network-vif-unplugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-3efa608a-e657-40c2-8a74-73bd0e76b2a8 req-cb5af8ab-f4fc-4f44-9ad6-fe12831adf41 service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-vif-unplugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23565656664353164', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565656664353164', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.objects.instance [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Instance destroyed successfully.
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.objects.instance [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lazy-loading 'resources' on Instance uuid 75b42e29-aba9-462e-bfe8-a9075c7c10ff {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-785231472',display_name='tempest-TestServerVolumeAttachmentScenario-server-785231472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-785231472',id=26,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFLFrWKZfXjwbl3fYKXgHZZB0GmgPPncDFWdwpiQwMYzeapzmKkQyRDD+gmq4hU+NH+fAh541pFruLBAmVhEEzx7nOP+Z7CwKejLHgKD7bcwZ/ERUHSWztpIOgkzE5wag==',key_name='tempest-keypair-717906883',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acf02bd3efdd416e93fb6cf48374640d',ramdisk_id='',reservation_id='r-ywdmr5m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-657705089',owner_user_name='tempest-TestServerVolumeAttachmentScenario-657705089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:15:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba022690804d4ec3a38b404666dc48c7',uuid=75b42e29-aba9-462e-bfe8-a9075c7c10ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Converting VIF {"id": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "address": "fa:16:3e:11:6f:36", "network": {"id": "dd1b6ad4-082e-4822-9610-f7c83a6e2fd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-531135802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acf02bd3efdd416e93fb6cf48374640d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ec1a30-00", "ovs_interfaceid": "57ec1a30-0005-4023-9cf9-1fe8a034a53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=57ec1a30-0005-4023-9cf9-1fe8a034a53e,network=Network(dd1b6ad4-082e-4822-9610-f7c83a6e2fd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ec1a30-00') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG os_vif [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=57ec1a30-0005-4023-9cf9-1fe8a034a53e,network=Network(dd1b6ad4-082e-4822-9610-f7c83a6e2fd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ec1a30-00') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57ec1a30-00, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:19:31 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:19:31 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:19:31 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:19:31 user nova-compute[74534]:   <serial>011cfed1-af50-4ce4-ab0c-1b4f4ff239e2</serial>
Nov 02 12:19:31 user nova-compute[74534]: </disk>
Nov 02 12:19:31 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e585aec-77a5-417a-a130-88df25523e33) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:31 user nova-compute[74534]: INFO os_vif [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:6f:36,bridge_name='br-int',has_traffic_filtering=True,id=57ec1a30-0005-4023-9cf9-1fe8a034a53e,network=Network(dd1b6ad4-082e-4822-9610-f7c83a6e2fd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ec1a30-00')
Nov 02 12:19:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Deleting instance files /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff_del
Nov 02 12:19:31 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Deletion of /opt/stack/data/nova/instances/75b42e29-aba9-462e-bfe8-a9075c7c10ff_del complete
Nov 02 12:19:31 user nova-compute[74534]: INFO nova.compute.manager [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 02 12:19:31 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:19:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] No VIF found with MAC fa:16:3e:70:85:c5, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-434aaa5a-3ac0-4135-95d6-7e6388fc4e53 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.722s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:32 user nova-compute[74534]: INFO nova.virt.block_device [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Booting with volume f6618bef-361d-4b05-8cb1-c3f031dc6fbb at /dev/vdb
Nov 02 12:19:32 user nova-compute[74534]: DEBUG os_brick.utils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf370bb-f313-4d6a-afef-bd587511e659]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ad43b-7082-4759-81f0-08f36e6b56f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7517cc-8851-48e8-88c5-eaef3157e826]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06448b2-c4f6-4bd0-9249-f5883ae31827]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:32 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[074cffdc-7c56-402c-85c5-2d459c0a81ae]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG os_brick.utils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating existing volume attachment record: 9a571c28-ddf9-4bbd-9e54-8f71a62d5ef0 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-ea4bf83e-1cd4-4a66-9267-1c4d4c66260d req-e0b3c253-7ae4-4f40-bd43-39c62969f6de service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea4bf83e-1cd4-4a66-9267-1c4d4c66260d req-e0b3c253-7ae4-4f40-bd43-39c62969f6de service nova] Acquiring lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea4bf83e-1cd4-4a66-9267-1c4d4c66260d req-e0b3c253-7ae4-4f40-bd43-39c62969f6de service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea4bf83e-1cd4-4a66-9267-1c4d4c66260d req-e0b3c253-7ae4-4f40-bd43-39c62969f6de service nova] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-ea4bf83e-1cd4-4a66-9267-1c4d4c66260d req-e0b3c253-7ae4-4f40-bd43-39c62969f6de service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] No waiting events found dispatching network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:32 user nova-compute[74534]: WARNING nova.compute.manager [req-ea4bf83e-1cd4-4a66-9267-1c4d4c66260d req-e0b3c253-7ae4-4f40-bd43-39c62969f6de service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received unexpected event network-vif-plugged-57ec1a30-0005-4023-9cf9-1fe8a034a53e for instance with vm_state active and task_state deleting.
Nov 02 12:19:32 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:32 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Took 1.52 seconds to deallocate network for instance.
Nov 02 12:19:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:33 user nova-compute[74534]: INFO nova.compute.manager [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Detaching volume c63f913f-63ef-4f50-8232-d41d2f0919f2
Nov 02 12:19:33 user nova-compute[74534]: INFO nova.virt.block_device [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Attempting to driver detach volume c63f913f-63ef-4f50-8232-d41d2f0919f2 from mountpoint /dev/vdb
Nov 02 12:19:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Attempting to detach device vdb from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:19:33 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:19:33 user nova-compute[74534]:   <source dev="/dev/sdg"/>
Nov 02 12:19:33 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:19:33 user nova-compute[74534]:   <serial>c63f913f-63ef-4f50-8232-d41d2f0919f2</serial>
Nov 02 12:19:33 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:19:33 user nova-compute[74534]: </disk>
Nov 02 12:19:33 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:19:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully detached device vdb from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the persistent domain config.
Nov 02 12:19:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:19:33 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:19:33 user nova-compute[74534]:   <source dev="/dev/sdg"/>
Nov 02 12:19:33 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:19:33 user nova-compute[74534]:   <serial>c63f913f-63ef-4f50-8232-d41d2f0919f2</serial>
Nov 02 12:19:33 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:19:33 user nova-compute[74534]: </disk>
Nov 02 12:19:33 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:33 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Deleted allocations for instance 75b42e29-aba9-462e-bfe8-a9075c7c10ff
Nov 02 12:19:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c17a4a04-ade3-4e46-b84c-ba1816f092b8 tempest-TestServerVolumeAttachmentScenario-657705089 tempest-TestServerVolumeAttachmentScenario-657705089-project-member] Lock "75b42e29-aba9-462e-bfe8-a9075c7c10ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:19:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-c9b87489-83b8-45f1-9e8c-5066eb1de384 req-41bbabfa-5bd6-410e-9e4b-e7ccd92dea5f service nova] [instance: 75b42e29-aba9-462e-bfe8-a9075c7c10ff] Received event network-vif-deleted-57ec1a30-0005-4023-9cf9-1fe8a034a53e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:43 user nova-compute[74534]: INFO nova.compute.manager [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Terminating instance
Nov 02 12:19:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-dce2e106-9d5c-4d0a-874c-fc759af0b6dd req-2cd5f8bc-d34c-4280-bec7-5ec0a9552a6b service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-vif-unplugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dce2e106-9d5c-4d0a-874c-fc759af0b6dd req-2cd5f8bc-d34c-4280-bec7-5ec0a9552a6b service nova] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dce2e106-9d5c-4d0a-874c-fc759af0b6dd req-2cd5f8bc-d34c-4280-bec7-5ec0a9552a6b service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-dce2e106-9d5c-4d0a-874c-fc759af0b6dd req-2cd5f8bc-d34c-4280-bec7-5ec0a9552a6b service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-dce2e106-9d5c-4d0a-874c-fc759af0b6dd req-2cd5f8bc-d34c-4280-bec7-5ec0a9552a6b service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] No waiting events found dispatching network-vif-unplugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-dce2e106-9d5c-4d0a-874c-fc759af0b6dd req-2cd5f8bc-d34c-4280-bec7-5ec0a9552a6b service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-vif-unplugged-6d2cb6a4-7508-4329-9906-e16f5e08123c for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:19:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Instance destroyed successfully.
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.objects.instance [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lazy-loading 'resources' on Instance uuid af8aed6f-de40-47e9-a777-0122aac6e29c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1401385634',display_name='tempest-AttachVolumeNegativeTest-server-1401385634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1401385634',id=29,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjMRyZgfu5uLcDn2l4+DR7SMj71ig4QWsjh7m6fMun3vPyPEupriY0q1Kep+sdM3RyT8NgDL2P7tuFJkF+HKJviGGaJlvzqBjPRMjvSfi2abVC9Uoif5KcGBbW0UFjMYg==',key_name='tempest-keypair-102699055',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcb68ce88ae4280ba6feb308b7c53da',ramdisk_id='',reservation_id='r-op7f51fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-322425016',owner_user_name='tempest-AttachVolumeNegativeTest-322425016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cb6a67fcb13459880727c825793db65',uuid=af8aed6f-de40-47e9-a777-0122aac6e29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converting VIF {"id": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "address": "fa:16:3e:c5:c6:82", "network": {"id": "8b1fc947-c520-43d9-86b7-9dfe913d50a9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-368154445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcb68ce88ae4280ba6feb308b7c53da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d2cb6a4-75", "ovs_interfaceid": "6d2cb6a4-7508-4329-9906-e16f5e08123c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:c6:82,bridge_name='br-int',has_traffic_filtering=True,id=6d2cb6a4-7508-4329-9906-e16f5e08123c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2cb6a4-75') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG os_vif [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:c6:82,bridge_name='br-int',has_traffic_filtering=True,id=6d2cb6a4-7508-4329-9906-e16f5e08123c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2cb6a4-75') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d2cb6a4-75, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7a88ff7-1510-4a37-85a0-b2029cd67d5a) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:44 user nova-compute[74534]: INFO os_vif [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:c6:82,bridge_name='br-int',has_traffic_filtering=True,id=6d2cb6a4-7508-4329-9906-e16f5e08123c,network=Network(8b1fc947-c520-43d9-86b7-9dfe913d50a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d2cb6a4-75')
Nov 02 12:19:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Deleting instance files /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c_del
Nov 02 12:19:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Deletion of /opt/stack/data/nova/instances/af8aed6f-de40-47e9-a777-0122aac6e29c_del complete
Nov 02 12:19:44 user nova-compute[74534]: INFO nova.compute.manager [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 02 12:19:44 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:19:44 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:19:45 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:45 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Took 0.87 seconds to deallocate network for instance.
Nov 02 12:19:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-f328bb3e-559b-4c6c-9360-fdd0749e4ed8 req-5f8e4ee9-fafe-4b54-9814-8b55da391ad2 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-vif-deleted-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:45 user nova-compute[74534]: INFO nova.compute.manager [req-f328bb3e-559b-4c6c-9360-fdd0749e4ed8 req-5f8e4ee9-fafe-4b54-9814-8b55da391ad2 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Neutron deleted interface 6d2cb6a4-7508-4329-9906-e16f5e08123c; detaching it from the instance and deleting it from the info cache
Nov 02 12:19:45 user nova-compute[74534]: DEBUG nova.network.neutron [req-f328bb3e-559b-4c6c-9360-fdd0749e4ed8 req-5f8e4ee9-fafe-4b54-9814-8b55da391ad2 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:19:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-f328bb3e-559b-4c6c-9360-fdd0749e4ed8 req-5f8e4ee9-fafe-4b54-9814-8b55da391ad2 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Detach interface failed, port_id=6d2cb6a4-7508-4329-9906-e16f5e08123c, reason: Instance af8aed6f-de40-47e9-a777-0122aac6e29c could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:19:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:46 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Deleted allocations for instance af8aed6f-de40-47e9-a777-0122aac6e29c
Nov 02 12:19:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-18a9473b-6c41-4ad6-b803-62149b139810 tempest-AttachVolumeNegativeTest-322425016 tempest-AttachVolumeNegativeTest-322425016-project-member] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.568s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-d79182eb-a979-485a-b043-a59448382ab1 req-15821e83-dd50-4e8a-8aa8-4dafdde40550 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received event network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d79182eb-a979-485a-b043-a59448382ab1 req-15821e83-dd50-4e8a-8aa8-4dafdde40550 service nova] Acquiring lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d79182eb-a979-485a-b043-a59448382ab1 req-15821e83-dd50-4e8a-8aa8-4dafdde40550 service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d79182eb-a979-485a-b043-a59448382ab1 req-15821e83-dd50-4e8a-8aa8-4dafdde40550 service nova] Lock "af8aed6f-de40-47e9-a777-0122aac6e29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-d79182eb-a979-485a-b043-a59448382ab1 req-15821e83-dd50-4e8a-8aa8-4dafdde40550 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] No waiting events found dispatching network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:46 user nova-compute[74534]: WARNING nova.compute.manager [req-d79182eb-a979-485a-b043-a59448382ab1 req-15821e83-dd50-4e8a-8aa8-4dafdde40550 service nova] [instance: af8aed6f-de40-47e9-a777-0122aac6e29c] Received unexpected event network-vif-plugged-6d2cb6a4-7508-4329-9906-e16f5e08123c for instance with vm_state deleted and task_state None.
Nov 02 12:19:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Starting finish_migration {{(pid=74534) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance directory exists: not creating {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 12:19:53 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Creating image(s)
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Ensure instance console log exists: /opt/stack/data/nova/instances/b7864c94-0468-459b-9f5e-86e85c28efed/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Start _get_guest_xml network_info=[{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2115201477-network", "vif_mac": "fa:16:3e:21:4c:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'eac3d69d-63da-40e1-bcbd-be654168146e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b7864c94-0468-459b-9f5e-86e85c28efed', 'attached_at': '2023-11-02T12:19:53.000000', 'detached_at': '', 'volume_id': '2984cf70-c44e-4474-863c-ea3f87f96db1', 'serial': '2984cf70-c44e-4474-863c-ea3f87f96db1'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:19:53 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:19:53 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:53 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e8e6d-4286-4c06-af69-24f2ca5b87ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:19:53 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c970fc43-969d-481b-be35-ca8938e22d28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1] added
Nov 02 12:19:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19dfada-29c1-48a7-be0b-c8dd718c74d9]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a54a52-3a93-4b04-86ea-3c2cad6d45f0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndFiYehR {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndFiYehR" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c394d-450f-4b31-84e8-1416e1813f93]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ndFiYehR'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59520876-a71f-42ba-ac16-7d309cddcca4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de25eec-34cf-4b52-8d33-a2a12864074a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b20d145-001d-4b57-a68b-dcf0d03c8fe8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]
Nov 02 12:19:53 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.
Nov 02 12:19:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd121d44-2526-494c-9ef5-622203c07b36]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1322c4e4-a9f7-4d66-ba86-e1ebc07154f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:19:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff2eab5-4e72-43fe-bfc1-5a3cff04a77c]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:53 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 868612a8-7a46-400e-add0-4eb7374ca056 is timed out.
Nov 02 12:19:53 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully detached device vdb from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the live domain config.
Nov 02 12:19:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldmQFLDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:19:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23634343061383964', 'path': '/dev/sde'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634343061383964', 'path': '/dev/sde'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.712s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344270638',display_name='tempest-ServerActionsTestOtherA-server-1344270638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344270638',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:17:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-dn1kg9xl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=b7864c94-0468-459b-9f5e-86e85c28efed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2115201477-network", "vif_mac": "fa:16:3e:21:4c:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2115201477-network", "vif_mac": "fa:16:3e:21:4c:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:19:54 user nova-compute[74534]:   <uuid>b7864c94-0468-459b-9f5e-86e85c28efed</uuid>
Nov 02 12:19:54 user nova-compute[74534]:   <name>instance-0000001f</name>
Nov 02 12:19:54 user nova-compute[74534]:   <memory>2097152</memory>
Nov 02 12:19:54 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:19:54 user nova-compute[74534]:   <metadata>
Nov 02 12:19:54 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:19:54 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:19:54 user nova-compute[74534]:       <nova:name>tempest-ServerActionsTestOtherA-server-1344270638</nova:name>
Nov 02 12:19:54 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:19:53</nova:creationTime>
Nov 02 12:19:54 user nova-compute[74534]:       <nova:flavor name="m1.small">
Nov 02 12:19:54 user nova-compute[74534]:         <nova:memory>2048</nova:memory>
Nov 02 12:19:54 user nova-compute[74534]:         <nova:disk>20</nova:disk>
Nov 02 12:19:54 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:19:54 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:19:54 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:19:54 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:19:54 user nova-compute[74534]:       <nova:owner>
Nov 02 12:19:54 user nova-compute[74534]:         <nova:user uuid="ec72fd62d437457ba42756f1da97516c">tempest-ServerActionsTestOtherA-500741581-project-member</nova:user>
Nov 02 12:19:54 user nova-compute[74534]:         <nova:project uuid="f787c9b1e8154b4da75ac5299c888706">tempest-ServerActionsTestOtherA-500741581</nova:project>
Nov 02 12:19:54 user nova-compute[74534]:       </nova:owner>
Nov 02 12:19:54 user nova-compute[74534]:       <nova:ports>
Nov 02 12:19:54 user nova-compute[74534]:         <nova:port uuid="9ce301a6-44ca-4ef0-81ce-3fa446504903">
Nov 02 12:19:54 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:19:54 user nova-compute[74534]:         </nova:port>
Nov 02 12:19:54 user nova-compute[74534]:       </nova:ports>
Nov 02 12:19:54 user nova-compute[74534]:     </nova:instance>
Nov 02 12:19:54 user nova-compute[74534]:   </metadata>
Nov 02 12:19:54 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:19:54 user nova-compute[74534]:     <system>
Nov 02 12:19:54 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:19:54 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:19:54 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:19:54 user nova-compute[74534]:       <entry name="serial">b7864c94-0468-459b-9f5e-86e85c28efed</entry>
Nov 02 12:19:54 user nova-compute[74534]:       <entry name="uuid">b7864c94-0468-459b-9f5e-86e85c28efed</entry>
Nov 02 12:19:54 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:19:54 user nova-compute[74534]:     </system>
Nov 02 12:19:54 user nova-compute[74534]:   </sysinfo>
Nov 02 12:19:54 user nova-compute[74534]:   <os>
Nov 02 12:19:54 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:19:54 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:19:54 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:19:54 user nova-compute[74534]:   </os>
Nov 02 12:19:54 user nova-compute[74534]:   <features>
Nov 02 12:19:54 user nova-compute[74534]:     <acpi/>
Nov 02 12:19:54 user nova-compute[74534]:     <apic/>
Nov 02 12:19:54 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:19:54 user nova-compute[74534]:   </features>
Nov 02 12:19:54 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:19:54 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:19:54 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:19:54 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:19:54 user nova-compute[74534]:   </clock>
Nov 02 12:19:54 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:19:54 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:19:54 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:19:54 user nova-compute[74534]:   </cpu>
Nov 02 12:19:54 user nova-compute[74534]:   <devices>
Nov 02 12:19:54 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:19:54 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:19:54 user nova-compute[74534]:       <source dev="/dev/sde"/>
Nov 02 12:19:54 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:19:54 user nova-compute[74534]:       <serial>2984cf70-c44e-4474-863c-ea3f87f96db1</serial>
Nov 02 12:19:54 user nova-compute[74534]:     </disk>
Nov 02 12:19:54 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:19:54 user nova-compute[74534]:       <mac address="fa:16:3e:21:4c:09"/>
Nov 02 12:19:54 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:19:54 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:19:54 user nova-compute[74534]:       <target dev="tap9ce301a6-44"/>
Nov 02 12:19:54 user nova-compute[74534]:     </interface>
Nov 02 12:19:54 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:19:54 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/b7864c94-0468-459b-9f5e-86e85c28efed/console.log" append="off"/>
Nov 02 12:19:54 user nova-compute[74534]:     </serial>
Nov 02 12:19:54 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:19:54 user nova-compute[74534]:     <video>
Nov 02 12:19:54 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:19:54 user nova-compute[74534]:     </video>
Nov 02 12:19:54 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:19:54 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:19:54 user nova-compute[74534]:     </rng>
Nov 02 12:19:54 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:19:54 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:19:54 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:19:54 user nova-compute[74534]:     </memballoon>
Nov 02 12:19:54 user nova-compute[74534]:   </devices>
Nov 02 12:19:54 user nova-compute[74534]: </domain>
Nov 02 12:19:54 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344270638',display_name='tempest-ServerActionsTestOtherA-server-1344270638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344270638',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:17:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-dn1kg9xl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=b7864c94-0468-459b-9f5e-86e85c28efed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2115201477-network", "vif_mac": "fa:16:3e:21:4c:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2115201477-network", "vif_mac": "fa:16:3e:21:4c:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_vif [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f34f7b6-c2bb-4654-8342-787dc6f865e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:19:54 user nova-compute[74534]: No targets found.
Nov 02 12:19:54 user nova-compute[74534]: iSNS:
Nov 02 12:19:54 user nova-compute[74534]: No targets found.
Nov 02 12:19:54 user nova-compute[74534]: STATIC:
Nov 02 12:19:54 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:19:54 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:54 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:54 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2
Nov 02 12:19:54 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:54 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:54 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:19:54 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:54 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:54 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:19:54 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:54 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:54 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2
Nov 02 12:19:54 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:19:54 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:19:54 user nova-compute[74534]: FIRMWARE:
Nov 02 12:19:54 user nova-compute[74534]: No targets found.
Nov 02 12:19:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:19:54 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:19:54 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '370d3980-d3eb-5ba7-bf86-20e80e6b1e32', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ce301a6-44, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ce301a6-44, col_values=(('qos', UUID('282d06eb-d56a-4376-bb82-888aa393d566')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ce301a6-44, col_values=(('external_ids', {'iface-id': '9ce301a6-44ca-4ef0-81ce-3fa446504903', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:4c:09', 'vm-uuid': 'b7864c94-0468-459b-9f5e-86e85c28efed'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16061d7a-46e9-43b5-8758-05cfd9261ce4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:54 user nova-compute[74534]: INFO os_vif [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44')
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: INFO nova.virt.block_device [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Booting with volume 19b76013-21e3-4fd7-b957-f0920f7a6477 at /dev/vdc
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[615c7d37-af95-407e-83e2-4dbd39f56c63]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:19:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe18034ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2'): ({'sdg'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Removing single pathed devices sdg {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf84dde-a6af-48f9-97e7-7cf1fe9790c0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] No VIF found with MAC fa:16:3e:21:4c:09, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.utils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b9c015-323d-472e-8527-80d7fe5d1e76]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flushing IO for device /dev/sdg {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f87572d-634e-45cb-ab70-f8d8d15b2bd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c6cdce-cf7a-470f-b467-16bda2c699ac]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b8ab13-4257-4fd5-a431-4df6e0f0efe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f7de3-44b4-4d95-89f2-db45191699c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6deae-fd9e-404d-a80d-0a879e6e9e37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6a8726-6539-42ac-b024-8c33fb0f0a63]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] SCSI volumes sdg have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:19:54 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbcff54-b54a-43a0-916b-43641983eb83]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.utils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating existing volume attachment record: 2bc11c4f-98b1-472c-a7ac-b38588239061 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f311e5f1-880f-41ef-a62d-2ebd7489a8be]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e5ab8f-c0bd-4e66-9d93-5f2ff9e1b053]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260]
Nov 02 12:19:54 user nova-compute[74534]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2, portal: 172.16.0.220,3260] successful.
Nov 02 12:19:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c63f913f-63ef-4f50-8232-d41d2f0919f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8f9d1d-2a14-49c8-a042-5a08b40190c6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== disconnect_volume: return (1112ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:19:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:19:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-3117fa5a-0409-445b-a169-9fb80959f0b6 req-401158fc-f3bd-41ce-b671-a0a16b7d60a1 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3117fa5a-0409-445b-a169-9fb80959f0b6 req-401158fc-f3bd-41ce-b671-a0a16b7d60a1 service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3117fa5a-0409-445b-a169-9fb80959f0b6 req-401158fc-f3bd-41ce-b671-a0a16b7d60a1 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3117fa5a-0409-445b-a169-9fb80959f0b6 req-401158fc-f3bd-41ce-b671-a0a16b7d60a1 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-3117fa5a-0409-445b-a169-9fb80959f0b6 req-401158fc-f3bd-41ce-b671-a0a16b7d60a1 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:56 user nova-compute[74534]: WARNING nova.compute.manager [req-3117fa5a-0409-445b-a169-9fb80959f0b6 req-401158fc-f3bd-41ce-b671-a0a16b7d60a1 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received unexpected event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with vm_state active and task_state resize_finish.
Nov 02 12:19:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:19:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance running successfully.
Nov 02 12:19:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Failed to set time: agent not configured {{(pid=74534) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 12:19:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65af264a-d4a8-4fe6-8a50-f05fc9b3fa80 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] finish_migration finished successfully. {{(pid=74534) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 12:19:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbd7ca21-58c0-4791-a5e4-4e25ff3d166d req-d6f252ac-269b-4d3a-8d8a-3f87ecd3816e service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:19:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd7ca21-58c0-4791-a5e4-4e25ff3d166d req-d6f252ac-269b-4d3a-8d8a-3f87ecd3816e service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:19:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd7ca21-58c0-4791-a5e4-4e25ff3d166d req-d6f252ac-269b-4d3a-8d8a-3f87ecd3816e service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:19:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fbd7ca21-58c0-4791-a5e4-4e25ff3d166d req-d6f252ac-269b-4d3a-8d8a-3f87ecd3816e service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:19:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-fbd7ca21-58c0-4791-a5e4-4e25ff3d166d req-d6f252ac-269b-4d3a-8d8a-3f87ecd3816e service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:19:58 user nova-compute[74534]: WARNING nova.compute.manager [req-fbd7ca21-58c0-4791-a5e4-4e25ff3d166d req-d6f252ac-269b-4d3a-8d8a-3f87ecd3816e service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received unexpected event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with vm_state resized and task_state None.
Nov 02 12:19:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:19:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:05 user nova-compute[74534]: DEBUG nova.objects.instance [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:20:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-9f20dee2-9ada-4a74-9673-f9341a83720f tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.946s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:05 user nova-compute[74534]: INFO nova.compute.manager [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Detaching volume 011cfed1-af50-4ce4-ab0c-1b4f4ff239e2
Nov 02 12:20:05 user nova-compute[74534]: INFO nova.virt.block_device [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Attempting to driver detach volume 011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 from mountpoint /dev/vdc
Nov 02 12:20:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Attempting to detach device vdc from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:20:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:20:05 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:20:05 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:20:05 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:20:05 user nova-compute[74534]:   <serial>011cfed1-af50-4ce4-ab0c-1b4f4ff239e2</serial>
Nov 02 12:20:05 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 12:20:05 user nova-compute[74534]: </disk>
Nov 02 12:20:05 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:20:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully detached device vdc from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the persistent domain config.
Nov 02 12:20:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:20:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:20:05 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:20:05 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:20:05 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:20:05 user nova-compute[74534]:   <serial>011cfed1-af50-4ce4-ab0c-1b4f4ff239e2</serial>
Nov 02 12:20:05 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 12:20:05 user nova-compute[74534]: </disk>
Nov 02 12:20:05 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:20:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:20:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:20:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:20:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:20:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7748MB free_disk=25.00101089477539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Applying migration context for instance b7864c94-0468-459b-9f5e-86e85c28efed as it has an incoming, in-progress migration b790b8d9-e290-4287-8c60-97c98c4baa33. Migration status is finished {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 12:20:11 user nova-compute[74534]: INFO nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating resource usage from migration b790b8d9-e290-4287-8c60-97c98c4baa33
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 868612a8-7a46-400e-add0-4eb7374ca056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Migration b790b8d9-e290-4287-8c60-97c98c4baa33 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:20:11 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:20:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:20:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:20:17 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Creating image(s)
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Ensure instance console log exists: /opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Start _get_guest_xml network_info=[{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'b3f95ea7-aa68-4b92-b3ed-7740c93679d2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWemICkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3', 'attached_at': '', 'detached_at': '', 'volume_id': '4fdbf051-f126-4797-a91b-cb37db875389', 'serial': '4fdbf051-f126-4797-a91b-cb37db875389'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'guest_format': None, 'attachment_id': '9a571c28-ddf9-4bbd-9e54-8f71a62d5ef0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgiDEwuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6618bef-361d-4b05-8cb1-c3f031dc6fbb', 'serial': 'f6618bef-361d-4b05-8cb1-c3f031dc6fbb'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'guest_format': None, 'attachment_id': '2bc11c4f-98b1-472c-a7ac-b38588239061', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJyswioX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3', 'attached_at': '', 'detached_at': '', 'volume_id': '19b76013-21e3-4fd7-b957-f0920f7a6477', 'serial': '19b76013-21e3-4fd7-b957-f0920f7a6477'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:20:17 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:20:17 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:20:17 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWemICkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:20:18 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:20:18 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:20:18 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a68fd9-07ab-4276-b1db-1cdcc963344e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:20:18 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd79f421-3f1a-4568-98c1-d0bdf6d6bfad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389] added
Nov 02 12:20:18 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[12634fc0-e0de-498f-969c-e54d33bba1e1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[31edd365-fc4c-46ce-96f4-06bbb313d351]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWemICkz {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWemICkz" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[58affd29-2d99-4553-b357-2e75e88cbac6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QWemICkz'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa0c2f-e9d5-4801-80dc-a2cf9269e06e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b1d1c-5170-4495-a4ee-fb5b3468b373]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f28f67c-c02f-4b5d-9843-580c1c146f40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260]
Nov 02 12:20:18 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260] successful.
Nov 02 12:20:18 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d140f-650d-4aa2-b601-366fad3b469b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bb8bf1-04a9-4b17-be7b-e8045f660cef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:18 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[24183d8e-a406-47f7-a3f8-6081f0123ef7]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWemICkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:20:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23432323264333936', 'path': '/dev/sdf'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432323264333936', 'path': '/dev/sdf'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgiDEwuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:20:19 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:20:19 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:20:19 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eb4537-b5c8-43f7-b6b4-4eedf2f56165]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:20:19 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd0678c-3599-4e35-a40f-b789f0fee8d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb] added
Nov 02 12:20:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7a0def-e2fd-44d8-b328-ab956d4e7928]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee145957-2773-4a1a-8985-a883e7d854a2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgiDEwuq {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgiDEwuq" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f9d5a5-9e79-4a40-84ff-49146a82b493]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dgiDEwuq'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc963fac-282a-4889-ad12-c0108a29332c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95d123-31f0-42ae-88c9-eabf6e7ae987]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[43240dfe-eef3-42e7-83c3-b5897c84f680]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260]
Nov 02 12:20:19 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260] successful.
Nov 02 12:20:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[284d8ac2-dcbe-4ed9-aa72-874f15bee036]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffa3612-1076-4dc6-a0aa-fe4a290c28f7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:19 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e2b4be-7b2a-4e56-9fd8-386d412f2c9d]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:20:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgiDEwuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26132646133373333', 'path': '/dev/sdg'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132646133373333', 'path': '/dev/sdg'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJyswioX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:20:20 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:20:20 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:20:20 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ac38c-d40e-4609-b748-0b690c6abf17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:20:20 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcbe0d7-39c9-477d-940d-db2a63db09a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477] added
Nov 02 12:20:20 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[255c397f-cb8c-4027-89bf-4730cb0ea6eb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[44137794-8c18-4c8a-b2ee-f24c5f577d59]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJyswioX {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJyswioX" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d09c5-2e94-43b5-a9ff-6361dfc186d0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJyswioX'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e6c74-8762-4f35-9d0c-3a44e62837d2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1ee0fa-8512-4eae-9410-05d17378ad00]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8fb41d-09c8-45c2-bbc1-57afda2aa5db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260]
Nov 02 12:20:21 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260] successful.
Nov 02 12:20:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[55351a6b-593e-4452-8f24-7eec56c1b6f9]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d2532-916a-42a1-994d-b95df9bf7a4c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:21 user nova-compute[74534]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)
Nov 02 12:20:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac8db3b-0b90-4a30-8c51-de80d45463a7]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJyswioX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23039363838376166', 'path': '/dev/sdh'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039363838376166', 'path': '/dev/sdh'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:90:52,bridge_name='br-int',has_traffic_filtering=True,id=0ee2046c-a1c2-4037-8d1b-377dd57da458,network=Network(3f055cd3-0836-4480-8858-17f7acacf1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee2046c-a1') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2b:b4,bridge_name='br-int',has_traffic_filtering=True,id=63c57fd1-3980-43a5-8543-8c05d7af97cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63c57fd1-39') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:89:de,bridge_name='br-int',has_traffic_filtering=True,id=a90c6ff2-2c7c-4769-be62-9273d12c46cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa90c6ff2-2c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:7f:99,bridge_name='br-int',has_traffic_filtering=True,id=908d040c-f503-44c6-b52d-4a52152d86d9,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908d040c-f5') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a1:f0,bridge_name='br-int',has_traffic_filtering=True,id=c3a06949-5196-4ffa-9cf9-448b251059d3,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a06949-51') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a433aab-09') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:6c,bridge_name='br-int',has_traffic_filtering=True,id=088b5ee3-9557-4697-8015-042bd42946d1,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088b5ee3-95') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.objects.instance [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lazy-loading 'pci_devices' on Instance uuid bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:20:22 user nova-compute[74534]:   <uuid>bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3</uuid>
Nov 02 12:20:22 user nova-compute[74534]:   <name>instance-00000021</name>
Nov 02 12:20:22 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:20:22 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:20:22 user nova-compute[74534]:   <metadata>
Nov 02 12:20:22 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:20:22 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:20:22 user nova-compute[74534]:       <nova:name>tempest-device-tagging-server-73507503</nova:name>
Nov 02 12:20:22 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:20:17</nova:creationTime>
Nov 02 12:20:22 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:20:22 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:20:22 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:20:22 user nova-compute[74534]:       <nova:owner>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:user uuid="7a4693f7b5e54a778c51c45228b31d9b">tempest-TaggedBootDevicesTest_v242-1847001711-project-member</nova:user>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:project uuid="844db01d167242c7ae0336faefedc180">tempest-TaggedBootDevicesTest_v242-1847001711</nova:project>
Nov 02 12:20:22 user nova-compute[74534]:       </nova:owner>
Nov 02 12:20:22 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:20:22 user nova-compute[74534]:       <nova:ports>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:port uuid="0ee2046c-a1c2-4037-8d1b-377dd57da458">
Nov 02 12:20:22 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 12:20:22 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:port uuid="63c57fd1-3980-43a5-8543-8c05d7af97cd">
Nov 02 12:20:22 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.25" ipVersion="4"/>
Nov 02 12:20:22 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:port uuid="a90c6ff2-2c7c-4769-be62-9273d12c46cd">
Nov 02 12:20:22 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.42" ipVersion="4"/>
Nov 02 12:20:22 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:port uuid="908d040c-f503-44c6-b52d-4a52152d86d9">
Nov 02 12:20:22 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.100" ipVersion="4"/>
Nov 02 12:20:22 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:port uuid="c3a06949-5196-4ffa-9cf9-448b251059d3">
Nov 02 12:20:22 user nova-compute[74534]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Nov 02 12:20:22 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:port uuid="5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e">
Nov 02 12:20:22 user nova-compute[74534]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 12:20:22 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:22 user nova-compute[74534]:         <nova:port uuid="088b5ee3-9557-4697-8015-042bd42946d1">
Nov 02 12:20:22 user nova-compute[74534]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 12:20:22 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:22 user nova-compute[74534]:       </nova:ports>
Nov 02 12:20:22 user nova-compute[74534]:     </nova:instance>
Nov 02 12:20:22 user nova-compute[74534]:   </metadata>
Nov 02 12:20:22 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:20:22 user nova-compute[74534]:     <system>
Nov 02 12:20:22 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:20:22 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:20:22 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:20:22 user nova-compute[74534]:       <entry name="serial">bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3</entry>
Nov 02 12:20:22 user nova-compute[74534]:       <entry name="uuid">bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3</entry>
Nov 02 12:20:22 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:20:22 user nova-compute[74534]:     </system>
Nov 02 12:20:22 user nova-compute[74534]:   </sysinfo>
Nov 02 12:20:22 user nova-compute[74534]:   <os>
Nov 02 12:20:22 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:20:22 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:20:22 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:20:22 user nova-compute[74534]:   </os>
Nov 02 12:20:22 user nova-compute[74534]:   <features>
Nov 02 12:20:22 user nova-compute[74534]:     <acpi/>
Nov 02 12:20:22 user nova-compute[74534]:     <apic/>
Nov 02 12:20:22 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:20:22 user nova-compute[74534]:   </features>
Nov 02 12:20:22 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:20:22 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:20:22 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:20:22 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:20:22 user nova-compute[74534]:   </clock>
Nov 02 12:20:22 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:20:22 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:20:22 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:20:22 user nova-compute[74534]:   </cpu>
Nov 02 12:20:22 user nova-compute[74534]:   <devices>
Nov 02 12:20:22 user nova-compute[74534]:     <disk type="file" device="cdrom">
Nov 02 12:20:22 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 12:20:22 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3/disk.config"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="hda" bus="ide"/>
Nov 02 12:20:22 user nova-compute[74534]:     </disk>
Nov 02 12:20:22 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:20:22 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:20:22 user nova-compute[74534]:       <source dev="/dev/sdf"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <serial>4fdbf051-f126-4797-a91b-cb37db875389</serial>
Nov 02 12:20:22 user nova-compute[74534]:     </disk>
Nov 02 12:20:22 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:20:22 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:20:22 user nova-compute[74534]:       <source dev="/dev/sdg"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <serial>f6618bef-361d-4b05-8cb1-c3f031dc6fbb</serial>
Nov 02 12:20:22 user nova-compute[74534]:     </disk>
Nov 02 12:20:22 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:20:22 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:20:22 user nova-compute[74534]:       <source dev="/dev/sdh"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="vdc" bus="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <serial>19b76013-21e3-4fd7-b957-f0920f7a6477</serial>
Nov 02 12:20:22 user nova-compute[74534]:     </disk>
Nov 02 12:20:22 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:22 user nova-compute[74534]:       <mac address="fa:16:3e:76:90:52"/>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="tap0ee2046c-a1"/>
Nov 02 12:20:22 user nova-compute[74534]:     </interface>
Nov 02 12:20:22 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:22 user nova-compute[74534]:       <mac address="fa:16:3e:cc:2b:b4"/>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="tap63c57fd1-39"/>
Nov 02 12:20:22 user nova-compute[74534]:     </interface>
Nov 02 12:20:22 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:22 user nova-compute[74534]:       <mac address="fa:16:3e:6f:89:de"/>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="tapa90c6ff2-2c"/>
Nov 02 12:20:22 user nova-compute[74534]:     </interface>
Nov 02 12:20:22 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:22 user nova-compute[74534]:       <mac address="fa:16:3e:7d:7f:99"/>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="tap908d040c-f5"/>
Nov 02 12:20:22 user nova-compute[74534]:     </interface>
Nov 02 12:20:22 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:22 user nova-compute[74534]:       <mac address="fa:16:3e:98:a1:f0"/>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="tapc3a06949-51"/>
Nov 02 12:20:22 user nova-compute[74534]:     </interface>
Nov 02 12:20:22 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:22 user nova-compute[74534]:       <mac address="fa:16:3e:e9:3c:9e"/>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="tap5a433aab-09"/>
Nov 02 12:20:22 user nova-compute[74534]:     </interface>
Nov 02 12:20:22 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:22 user nova-compute[74534]:       <mac address="fa:16:3e:05:6e:6c"/>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:22 user nova-compute[74534]:       <target dev="tap088b5ee3-95"/>
Nov 02 12:20:22 user nova-compute[74534]:     </interface>
Nov 02 12:20:22 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:20:22 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3/console.log" append="off"/>
Nov 02 12:20:22 user nova-compute[74534]:     </serial>
Nov 02 12:20:22 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:20:22 user nova-compute[74534]:     <video>
Nov 02 12:20:22 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:22 user nova-compute[74534]:     </video>
Nov 02 12:20:22 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:20:22 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:20:22 user nova-compute[74534]:     </rng>
Nov 02 12:20:22 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:20:22 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:20:22 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:20:22 user nova-compute[74534]:     </memballoon>
Nov 02 12:20:22 user nova-compute[74534]:   </devices>
Nov 02 12:20:22 user nova-compute[74534]: </domain>
Nov 02 12:20:22 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:90:52,bridge_name='br-int',has_traffic_filtering=True,id=0ee2046c-a1c2-4037-8d1b-377dd57da458,network=Network(3f055cd3-0836-4480-8858-17f7acacf1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee2046c-a1') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:90:52,bridge_name='br-int',has_traffic_filtering=True,id=0ee2046c-a1c2-4037-8d1b-377dd57da458,network=Network(3f055cd3-0836-4480-8858-17f7acacf1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee2046c-a1') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe09d06b-32f1-553f-8259-95741e79dd6d', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee2046c-a1, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ee2046c-a1, col_values=(('qos', UUID('d7fccea3-7317-4c76-9ffa-5b62edd8f2aa')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ee2046c-a1, col_values=(('external_ids', {'iface-id': '0ee2046c-a1c2-4037-8d1b-377dd57da458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:90:52', 'vm-uuid': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: INFO os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:90:52,bridge_name='br-int',has_traffic_filtering=True,id=0ee2046c-a1c2-4037-8d1b-377dd57da458,network=Network(3f055cd3-0836-4480-8858-17f7acacf1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee2046c-a1')
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2b:b4,bridge_name='br-int',has_traffic_filtering=True,id=63c57fd1-3980-43a5-8543-8c05d7af97cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63c57fd1-39') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2b:b4,bridge_name='br-int',has_traffic_filtering=True,id=63c57fd1-3980-43a5-8543-8c05d7af97cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63c57fd1-39') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acbc57f9-3d24-52bf-b683-9156b7d7280b', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63c57fd1-39, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63c57fd1-39, col_values=(('qos', UUID('2a32409f-1931-4c83-b884-563dd4d3350f')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63c57fd1-39, col_values=(('external_ids', {'iface-id': '63c57fd1-3980-43a5-8543-8c05d7af97cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:2b:b4', 'vm-uuid': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: INFO os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2b:b4,bridge_name='br-int',has_traffic_filtering=True,id=63c57fd1-3980-43a5-8543-8c05d7af97cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63c57fd1-39')
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:89:de,bridge_name='br-int',has_traffic_filtering=True,id=a90c6ff2-2c7c-4769-be62-9273d12c46cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa90c6ff2-2c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:89:de,bridge_name='br-int',has_traffic_filtering=True,id=a90c6ff2-2c7c-4769-be62-9273d12c46cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa90c6ff2-2c') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26d5e930-7fe7-57fa-aa23-f114baff1027', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa90c6ff2-2c, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa90c6ff2-2c, col_values=(('qos', UUID('5682b74f-e86e-4840-bd07-426cdaaffc3b')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa90c6ff2-2c, col_values=(('external_ids', {'iface-id': 'a90c6ff2-2c7c-4769-be62-9273d12c46cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:89:de', 'vm-uuid': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: INFO os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:89:de,bridge_name='br-int',has_traffic_filtering=True,id=a90c6ff2-2c7c-4769-be62-9273d12c46cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa90c6ff2-2c')
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:7f:99,bridge_name='br-int',has_traffic_filtering=True,id=908d040c-f503-44c6-b52d-4a52152d86d9,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908d040c-f5') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:7f:99,bridge_name='br-int',has_traffic_filtering=True,id=908d040c-f503-44c6-b52d-4a52152d86d9,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908d040c-f5') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d6b701b-ce9c-5e52-bb27-d57996d5ac8a', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap908d040c-f5, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap908d040c-f5, col_values=(('qos', UUID('a478279c-a2ee-403f-9934-be73c1f59e5f')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap908d040c-f5, col_values=(('external_ids', {'iface-id': '908d040c-f503-44c6-b52d-4a52152d86d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:7f:99', 'vm-uuid': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: INFO os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:7f:99,bridge_name='br-int',has_traffic_filtering=True,id=908d040c-f503-44c6-b52d-4a52152d86d9,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908d040c-f5')
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a1:f0,bridge_name='br-int',has_traffic_filtering=True,id=c3a06949-5196-4ffa-9cf9-448b251059d3,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a06949-51') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a1:f0,bridge_name='br-int',has_traffic_filtering=True,id=c3a06949-5196-4ffa-9cf9-448b251059d3,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a06949-51') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b400ef70-7765-5413-a773-28151282b44d', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a06949-51, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3a06949-51, col_values=(('qos', UUID('40e2f399-556e-46a6-8b7f-ff6f01b4bfb3')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3a06949-51, col_values=(('external_ids', {'iface-id': 'c3a06949-5196-4ffa-9cf9-448b251059d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:a1:f0', 'vm-uuid': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: INFO os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a1:f0,bridge_name='br-int',has_traffic_filtering=True,id=c3a06949-5196-4ffa-9cf9-448b251059d3,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a06949-51')
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a433aab-09') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a433aab-09') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf2d4e57-f4fc-5283-b997-88d47fa72ac6', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a433aab-09, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a433aab-09, col_values=(('qos', UUID('4a8b1604-1ee6-47a4-b825-7af3d19ee8a1')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a433aab-09, col_values=(('external_ids', {'iface-id': '5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:3c:9e', 'vm-uuid': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: INFO os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a433aab-09')
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:6c,bridge_name='br-int',has_traffic_filtering=True,id=088b5ee3-9557-4697-8015-042bd42946d1,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088b5ee3-95') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:6c,bridge_name='br-int',has_traffic_filtering=True,id=088b5ee3-9557-4697-8015-042bd42946d1,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088b5ee3-95') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5345ab19-2679-5a8f-9fb8-580842b93d1c', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap088b5ee3-95, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap088b5ee3-95, col_values=(('qos', UUID('9352e676-930b-4b7e-8e56-28743b788153')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap088b5ee3-95, col_values=(('external_ids', {'iface-id': '088b5ee3-9557-4697-8015-042bd42946d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:6e:6c', 'vm-uuid': 'bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:23 user nova-compute[74534]: INFO os_vif [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:6c,bridge_name='br-int',has_traffic_filtering=True,id=088b5ee3-9557-4697-8015-042bd42946d1,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088b5ee3-95')
Nov 02 12:20:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] No BDM found with device name hda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:20:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:20:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] No VIF found with MAC fa:16:3e:76:90:52, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:20:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] No VIF found with MAC fa:16:3e:98:a1:f0, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:20:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Using config drive
Nov 02 12:20:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Creating config drive at /opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3/disk.config
Nov 02 12:20:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp499t4koa {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp499t4koa" returned: 0 in 0.071s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-18e54438-ca8b-4cd1-a10b-97df28c0ee74 req-5150d11b-a9ef-48d0-b9e9-77503c3827b2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-18e54438-ca8b-4cd1-a10b-97df28c0ee74 req-5150d11b-a9ef-48d0-b9e9-77503c3827b2 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-18e54438-ca8b-4cd1-a10b-97df28c0ee74 req-5150d11b-a9ef-48d0-b9e9-77503c3827b2 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-18e54438-ca8b-4cd1-a10b-97df28c0ee74 req-5150d11b-a9ef-48d0-b9e9-77503c3827b2 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-18e54438-ca8b-4cd1-a10b-97df28c0ee74 req-5150d11b-a9ef-48d0-b9e9-77503c3827b2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:25 user nova-compute[74534]: WARNING nova.compute.manager [req-18e54438-ca8b-4cd1-a10b-97df28c0ee74 req-5150d11b-a9ef-48d0-b9e9-77503c3827b2 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 for instance with vm_state building and task_state spawning.
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-a24fb40a-2681-4672-860a-88ab90ed0982 req-94ad4b86-c4ba-4860-b081-e9de766505b8 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a24fb40a-2681-4672-860a-88ab90ed0982 req-94ad4b86-c4ba-4860-b081-e9de766505b8 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a24fb40a-2681-4672-860a-88ab90ed0982 req-94ad4b86-c4ba-4860-b081-e9de766505b8 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a24fb40a-2681-4672-860a-88ab90ed0982 req-94ad4b86-c4ba-4860-b081-e9de766505b8 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-a24fb40a-2681-4672-860a-88ab90ed0982 req-94ad4b86-c4ba-4860-b081-e9de766505b8 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:25 user nova-compute[74534]: WARNING nova.compute.manager [req-a24fb40a-2681-4672-860a-88ab90ed0982 req-94ad4b86-c4ba-4860-b081-e9de766505b8 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd for instance with vm_state building and task_state spawning.
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:20:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 868612a8-7a46-400e-add0-4eb7374ca056 is timed out.
Nov 02 12:20:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully detached device vdc from instance 868612a8-7a46-400e-add0-4eb7374ca056 from the live domain config.
Nov 02 12:20:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSQOEWxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:20:26 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8e68e8-e6eb-4133-adb9-eaeef61e7a20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:20:26 user nova-compute[74534]: No targets found.
Nov 02 12:20:26 user nova-compute[74534]: iSNS:
Nov 02 12:20:26 user nova-compute[74534]: No targets found.
Nov 02 12:20:26 user nova-compute[74534]: STATIC:
Nov 02 12:20:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:20:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:20:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:20:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389
Nov 02 12:20:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:20:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:20:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb
Nov 02 12:20:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:20:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:20:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:20:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:20:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:20:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:20:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:20:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:20:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2
Nov 02 12:20:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:20:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:20:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477
Nov 02 12:20:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:20:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:20:26 user nova-compute[74534]: FIRMWARE:
Nov 02 12:20:26 user nova-compute[74534]: No targets found.
Nov 02 12:20:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:20:26 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:20:26 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e52c8a-ddd7-45be-a336-68f3f5356d1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f18fe-4b37-4cdb-8744-647e14871199]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:20:26 user nova-compute[74534]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)
Nov 02 12:20:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c780940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:20:26 user nova-compute[74534]: INFO nova.compute.claims [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Claim successful on node user
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b89b63-2515-4985-bda4-b2c6887a4f31]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aea29b-c088-4b1c-a8fe-ad24665da9eb]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d560476f-33fc-4a71-beb2-de9a92528b9e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea7b11-80f5-4727-9e0c-cebc1450c804]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.123s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[19904a28-c903-4627-91be-c1f48ca7f5a5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[77413e32-6945-4270-8efa-903b80973d2e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260]
Nov 02 12:20:26 user nova-compute[74534]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2, portal: 172.16.0.220,3260] successful.
Nov 02 12:20:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:011cfed1-af50-4ce4-ab0c-1b4f4ff239e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2471b24-a599-4f20-a6d1-e024bd9cb37b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.590s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] <== disconnect_volume: return (593ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.890s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-9f9d1997-d37e-4e54-9efa-e3bfb2649d49 req-e8b16000-0d23-4c86-b8bc-ef841e48c62a service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-1f459921-872b-42c6-ab5c-18da69be9040 req-588690be-93b0-41ec-81a0-f601c238f71b service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1f459921-872b-42c6-ab5c-18da69be9040 req-588690be-93b0-41ec-81a0-f601c238f71b service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1f459921-872b-42c6-ab5c-18da69be9040 req-588690be-93b0-41ec-81a0-f601c238f71b service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1f459921-872b-42c6-ab5c-18da69be9040 req-588690be-93b0-41ec-81a0-f601c238f71b service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-1f459921-872b-42c6-ab5c-18da69be9040 req-588690be-93b0-41ec-81a0-f601c238f71b service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-1f459921-872b-42c6-ab5c-18da69be9040 req-588690be-93b0-41ec-81a0-f601c238f71b service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.policy [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0dabe5e283645a382a1f0bf6ab7ddf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294df1c916c248d496812d8b2bb1b57e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:20:27 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Creating image(s)
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.217s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:27 user nova-compute[74534]: WARNING nova.compute.manager [req-2956187e-d8a2-432c-b19d-5419d914311d req-ca87aaa8-d0d8-47fd-8c22-833967cec245 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 for instance with vm_state building and task_state spawning.
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.215s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG nova.objects.instance [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'flavor' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk 1073741824" returned: 0 in 0.068s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-449ae3eb-ae08-4bd1-a5b3-183f3f33caca tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.617s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.279s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Cannot resize image /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Ensure instance console log exists: /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Successfully created port: 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:29 user nova-compute[74534]: INFO nova.compute.manager [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Terminating instance
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-6f940939-f25d-4450-a2f8-41c15222e936 req-f64b9e11-bc6e-4305-8515-7bebf8543f47 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6f940939-f25d-4450-a2f8-41c15222e936 req-f64b9e11-bc6e-4305-8515-7bebf8543f47 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6f940939-f25d-4450-a2f8-41c15222e936 req-f64b9e11-bc6e-4305-8515-7bebf8543f47 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6f940939-f25d-4450-a2f8-41c15222e936 req-f64b9e11-bc6e-4305-8515-7bebf8543f47 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-6f940939-f25d-4450-a2f8-41c15222e936 req-f64b9e11-bc6e-4305-8515-7bebf8543f47 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:29 user nova-compute[74534]: WARNING nova.compute.manager [req-6f940939-f25d-4450-a2f8-41c15222e936 req-f64b9e11-bc6e-4305-8515-7bebf8543f47 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e for instance with vm_state building and task_state spawning.
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Successfully updated port: 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing instance network info cache due to event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-00f525c6-0e9f-40ce-811b-b39bb57a7cc5 req-334f9b79-01aa-473a-afd7-db6e359fe1c9 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-00f525c6-0e9f-40ce-811b-b39bb57a7cc5 req-334f9b79-01aa-473a-afd7-db6e359fe1c9 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-00f525c6-0e9f-40ce-811b-b39bb57a7cc5 req-334f9b79-01aa-473a-afd7-db6e359fe1c9 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-00f525c6-0e9f-40ce-811b-b39bb57a7cc5 req-334f9b79-01aa-473a-afd7-db6e359fe1c9 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-00f525c6-0e9f-40ce-811b-b39bb57a7cc5 req-334f9b79-01aa-473a-afd7-db6e359fe1c9 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:29 user nova-compute[74534]: WARNING nova.compute.manager [req-00f525c6-0e9f-40ce-811b-b39bb57a7cc5 req-334f9b79-01aa-473a-afd7-db6e359fe1c9 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 for instance with vm_state building and task_state spawning.
Nov 02 12:20:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Instance destroyed successfully.
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lazy-loading 'resources' on Instance uuid 868612a8-7a46-400e-add0-4eb7374ca056 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance network_info: |[{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1955977745',display_name='tempest-AttachVolumeTestJSON-server-1955977745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1955977745',id=28,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE8TMUP1YXRO06BPy7geuZdEW2xWzEAqb2J4iiUysxqB5JGyMzpFoFydlV/xMoLzYwg/wvl84USouFusQS62Ahpu7ZxGJvyj9GEQkbAgxEEC+w2T+4RbNo9cW+gPdmRow==',key_name='tempest-keypair-170572953',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:16:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f40e1ed522748be85c5bdd3b6405652',ramdisk_id='',reservation_id='r-luikb13w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1871374392',owner_user_name='tempest-AttachVolumeTestJSON-1871374392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4eb3d0118fba4c4eb8edebcb7e68eb93',uuid=868612a8-7a46-400e-add0-4eb7374ca056,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converting VIF {"id": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "address": "fa:16:3e:70:85:c5", "network": {"id": "197d0dde-2571-453c-9458-16182c6cff31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1286445228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f40e1ed522748be85c5bdd3b6405652", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce1e36c-38", "ovs_interfaceid": "3ce1e36c-386e-4249-8b97-dfc61c15ad5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:85:c5,bridge_name='br-int',has_traffic_filtering=True,id=3ce1e36c-386e-4249-8b97-dfc61c15ad5a,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce1e36c-38') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG os_vif [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:85:c5,bridge_name='br-int',has_traffic_filtering=True,id=3ce1e36c-386e-4249-8b97-dfc61c15ad5a,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce1e36c-38') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.network.neutron [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Start _get_guest_xml network_info=[{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce1e36c-38, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69207a14-34a4-47c5-89bc-9102e91c90a9) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:29 user nova-compute[74534]: INFO os_vif [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:85:c5,bridge_name='br-int',has_traffic_filtering=True,id=3ce1e36c-386e-4249-8b97-dfc61c15ad5a,network=Network(197d0dde-2571-453c-9458-16182c6cff31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce1e36c-38')
Nov 02 12:20:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Deleting instance files /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056_del
Nov 02 12:20:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Deletion of /opt/stack/data/nova/instances/868612a8-7a46-400e-add0-4eb7374ca056_del complete
Nov 02 12:20:30 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:20:30 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2096656522',display_name='tempest-ServerRescueNegativeTestJSON-server-2096656522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2096656522',id=34,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwBvnAFBaomGwtXuR0NJ8EhEfw65vBp4jQPxtgOkXGSyhXiIkLJnbT9dVjv6sat647ZUyfRWtGQxP50/jmy14imFFE3MhsD15fHSOQtWHVu73D30wcZ7sqQzS5lGVFZ6w==',key_name='tempest-keypair-1795761394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-p0jltjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=1b445fab-5562-418a-b14a-d25da40f3fc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.objects.instance [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:20:30 user nova-compute[74534]:   <uuid>1b445fab-5562-418a-b14a-d25da40f3fc1</uuid>
Nov 02 12:20:30 user nova-compute[74534]:   <name>instance-00000022</name>
Nov 02 12:20:30 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:20:30 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:20:30 user nova-compute[74534]:   <metadata>
Nov 02 12:20:30 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:20:30 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:20:30 user nova-compute[74534]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2096656522</nova:name>
Nov 02 12:20:30 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:20:30</nova:creationTime>
Nov 02 12:20:30 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:20:30 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:20:30 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:20:30 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:20:30 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:20:30 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:20:30 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:20:30 user nova-compute[74534]:       <nova:owner>
Nov 02 12:20:30 user nova-compute[74534]:         <nova:user uuid="c0dabe5e283645a382a1f0bf6ab7ddf1">tempest-ServerRescueNegativeTestJSON-158551613-project-member</nova:user>
Nov 02 12:20:30 user nova-compute[74534]:         <nova:project uuid="294df1c916c248d496812d8b2bb1b57e">tempest-ServerRescueNegativeTestJSON-158551613</nova:project>
Nov 02 12:20:30 user nova-compute[74534]:       </nova:owner>
Nov 02 12:20:30 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:20:30 user nova-compute[74534]:       <nova:ports>
Nov 02 12:20:30 user nova-compute[74534]:         <nova:port uuid="89e9cb38-0ab9-44e6-8ec3-5afabcd4c169">
Nov 02 12:20:30 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:20:30 user nova-compute[74534]:         </nova:port>
Nov 02 12:20:30 user nova-compute[74534]:       </nova:ports>
Nov 02 12:20:30 user nova-compute[74534]:     </nova:instance>
Nov 02 12:20:30 user nova-compute[74534]:   </metadata>
Nov 02 12:20:30 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:20:30 user nova-compute[74534]:     <system>
Nov 02 12:20:30 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:20:30 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:20:30 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:20:30 user nova-compute[74534]:       <entry name="serial">1b445fab-5562-418a-b14a-d25da40f3fc1</entry>
Nov 02 12:20:30 user nova-compute[74534]:       <entry name="uuid">1b445fab-5562-418a-b14a-d25da40f3fc1</entry>
Nov 02 12:20:30 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:20:30 user nova-compute[74534]:     </system>
Nov 02 12:20:30 user nova-compute[74534]:   </sysinfo>
Nov 02 12:20:30 user nova-compute[74534]:   <os>
Nov 02 12:20:30 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:20:30 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:20:30 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:20:30 user nova-compute[74534]:   </os>
Nov 02 12:20:30 user nova-compute[74534]:   <features>
Nov 02 12:20:30 user nova-compute[74534]:     <acpi/>
Nov 02 12:20:30 user nova-compute[74534]:     <apic/>
Nov 02 12:20:30 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:20:30 user nova-compute[74534]:   </features>
Nov 02 12:20:30 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:20:30 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:20:30 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:20:30 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:20:30 user nova-compute[74534]:   </clock>
Nov 02 12:20:30 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:20:30 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:20:30 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:20:30 user nova-compute[74534]:   </cpu>
Nov 02 12:20:30 user nova-compute[74534]:   <devices>
Nov 02 12:20:30 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:20:30 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:20:30 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk"/>
Nov 02 12:20:30 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:20:30 user nova-compute[74534]:     </disk>
Nov 02 12:20:30 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:20:30 user nova-compute[74534]:       <mac address="fa:16:3e:ac:cf:7b"/>
Nov 02 12:20:30 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:30 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:20:30 user nova-compute[74534]:       <target dev="tap89e9cb38-0a"/>
Nov 02 12:20:30 user nova-compute[74534]:     </interface>
Nov 02 12:20:30 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:20:30 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/console.log" append="off"/>
Nov 02 12:20:30 user nova-compute[74534]:     </serial>
Nov 02 12:20:30 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:20:30 user nova-compute[74534]:     <video>
Nov 02 12:20:30 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:20:30 user nova-compute[74534]:     </video>
Nov 02 12:20:30 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:20:30 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:20:30 user nova-compute[74534]:     </rng>
Nov 02 12:20:30 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:20:30 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:20:30 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:20:30 user nova-compute[74534]:     </memballoon>
Nov 02 12:20:30 user nova-compute[74534]:   </devices>
Nov 02 12:20:30 user nova-compute[74534]: </domain>
Nov 02 12:20:30 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2096656522',display_name='tempest-ServerRescueNegativeTestJSON-server-2096656522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2096656522',id=34,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwBvnAFBaomGwtXuR0NJ8EhEfw65vBp4jQPxtgOkXGSyhXiIkLJnbT9dVjv6sat647ZUyfRWtGQxP50/jmy14imFFE3MhsD15fHSOQtWHVu73D30wcZ7sqQzS5lGVFZ6w==',key_name='tempest-keypair-1795761394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-p0jltjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=1b445fab-5562-418a-b14a-d25da40f3fc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG os_vif [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7bafccf-f6cc-56c0-a702-8cbab7a262b2', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance spawned successfully.
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89e9cb38-0a, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89e9cb38-0a, col_values=(('qos', UUID('87cf104d-3abf-4091-bc99-3e390e18cba5')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89e9cb38-0a, col_values=(('external_ids', {'iface-id': '89e9cb38-0ab9-44e6-8ec3-5afabcd4c169', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:cf:7b', 'vm-uuid': '1b445fab-5562-418a-b14a-d25da40f3fc1'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:20:30 user nova-compute[74534]: INFO nova.compute.manager [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 02 12:20:30 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:30 user nova-compute[74534]: INFO os_vif [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a')
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No VIF found with MAC fa:16:3e:ac:cf:7b, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:20:30 user nova-compute[74534]: INFO nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Took 12.39 seconds to spawn the instance on the hypervisor.
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:20:30 user nova-compute[74534]: INFO nova.compute.manager [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Took 84.07 seconds to build instance.
Nov 02 12:20:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-83da754d-40a9-4964-b59c-05faaca4cc38 tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 84.186s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.network.neutron [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updated VIF entry in instance network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG nova.network.neutron [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:20:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d5bbba80-c378-4d23-949e-53e38202a51d req-27f791c5-9ab6-4aec-91e9-74f141f4c371 service nova] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:20:31 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Took 1.21 seconds to deallocate network for instance.
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received event network-vif-unplugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] No waiting events found dispatching network-vif-unplugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:31 user nova-compute[74534]: WARNING nova.compute.manager [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received unexpected event network-vif-unplugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a for instance with vm_state deleted and task_state None.
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received event network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] Acquiring lock "868612a8-7a46-400e-add0-4eb7374ca056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] Lock "868612a8-7a46-400e-add0-4eb7374ca056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] No waiting events found dispatching network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:31 user nova-compute[74534]: WARNING nova.compute.manager [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received unexpected event network-vif-plugged-3ce1e36c-386e-4249-8b97-dfc61c15ad5a for instance with vm_state deleted and task_state None.
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-ccc51cf3-59c6-4c3b-9826-44da5ddb9f3c req-d8cfba26-f601-4917-ace6-d5ad9f438995 service nova] [instance: 868612a8-7a46-400e-add0-4eb7374ca056] Received event network-vif-deleted-3ce1e36c-386e-4249-8b97-dfc61c15ad5a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:20:31 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:20:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.636s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:32 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Deleted allocations for instance 868612a8-7a46-400e-add0-4eb7374ca056
Nov 02 12:20:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e9e5bec4-6cf1-4d48-a26a-ec39894d12a5 tempest-AttachVolumeTestJSON-1871374392 tempest-AttachVolumeTestJSON-1871374392-project-member] Lock "868612a8-7a46-400e-add0-4eb7374ca056" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.252s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:33 user nova-compute[74534]: WARNING nova.compute.manager [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state building and task_state spawning.
Nov 02 12:20:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:20:33 user nova-compute[74534]: WARNING nova.compute.manager [req-48d4f3fe-7c8e-4625-b73d-121b15068fe4 req-3424af97-f627-45a1-96d6-b24b3225afaf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state building and task_state spawning.
Nov 02 12:20:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:20:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance spawned successfully.
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:20:34 user nova-compute[74534]: INFO nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 02 12:20:34 user nova-compute[74534]: DEBUG nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:20:34 user nova-compute[74534]: INFO nova.compute.manager [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Took 8.41 seconds to build instance.
Nov 02 12:20:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-8600a2f3-68db-48da-baa5-611224bd9793 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.570s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:20:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:20:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:20:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:20:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:20:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:20:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:20:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:20:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:05 user nova-compute[74534]: INFO nova.compute.manager [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Unrescuing
Nov 02 12:21:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquired lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG nova.network.neutron [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updating instance_info_cache with network_info: [{"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Releasing lock "refresh_cache-1dd3521d-944a-4d86-bcf5-d5988b6f923c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG nova.objects.instance [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'flavor' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-2d77f8fe-f8ae-4ffd-8918-cc6dba4b3fe4 req-943cf3bb-ab74-4bb4-b1de-d742601c4291 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2d77f8fe-f8ae-4ffd-8918-cc6dba4b3fe4 req-943cf3bb-ab74-4bb4-b1de-d742601c4291 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2d77f8fe-f8ae-4ffd-8918-cc6dba4b3fe4 req-943cf3bb-ab74-4bb4-b1de-d742601c4291 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2d77f8fe-f8ae-4ffd-8918-cc6dba4b3fe4 req-943cf3bb-ab74-4bb4-b1de-d742601c4291 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-2d77f8fe-f8ae-4ffd-8918-cc6dba4b3fe4 req-943cf3bb-ab74-4bb4-b1de-d742601c4291 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:06 user nova-compute[74534]: WARNING nova.compute.manager [req-2d77f8fe-f8ae-4ffd-8918-cc6dba4b3fe4 req-943cf3bb-ab74-4bb4-b1de-d742601c4291 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:21:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance destroyed successfully.
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 3390f6a1-9306-42a3-af5a-b26e113c0b08 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updating instance_info_cache with network_info: [{"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-3390f6a1-9306-42a3-af5a-b26e113c0b08" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:08 user nova-compute[74534]: WARNING nova.compute.manager [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:21:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:08 user nova-compute[74534]: WARNING nova.compute.manager [req-7dd8dc76-9767-47ed-bf1f-83780fedb273 req-e333ecf1-b17a-4d84-849d-f496fd2a659f service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:21:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-69d4d513-1e0b-4e2d-a90d-c842215b96a8 req-d8aee534-b3d7-4e8a-80d2-1d30a84aa5b4 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-69d4d513-1e0b-4e2d-a90d-c842215b96a8 req-d8aee534-b3d7-4e8a-80d2-1d30a84aa5b4 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-69d4d513-1e0b-4e2d-a90d-c842215b96a8 req-d8aee534-b3d7-4e8a-80d2-1d30a84aa5b4 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-69d4d513-1e0b-4e2d-a90d-c842215b96a8 req-d8aee534-b3d7-4e8a-80d2-1d30a84aa5b4 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-69d4d513-1e0b-4e2d-a90d-c842215b96a8 req-d8aee534-b3d7-4e8a-80d2-1d30a84aa5b4 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:10 user nova-compute[74534]: WARNING nova.compute.manager [req-69d4d513-1e0b-4e2d-a90d-c842215b96a8 req-d8aee534-b3d7-4e8a-80d2-1d30a84aa5b4 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:21:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG nova.compute.manager [None req-486c0501-6003-4a17-98a1-5cdc53585eb1 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:14 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:21:14 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7437MB free_disk=24.994800567626953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Applying migration context for instance b7864c94-0468-459b-9f5e-86e85c28efed as it has an incoming, in-progress migration b790b8d9-e290-4287-8c60-97c98c4baa33. Migration status is finished {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 12:21:14 user nova-compute[74534]: INFO nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating resource usage from migration b790b8d9-e290-4287-8c60-97c98c4baa33
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Migration b790b8d9-e290-4287-8c60-97c98c4baa33 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1b445fab-5562-418a-b14a-d25da40f3fc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:21:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.917s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 3 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:21:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Deletion of /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize failed
Nov 02 12:21:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Going to confirm migration 2 {{(pid=74534) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquired lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'info_cache' on Instance uuid b7864c94-0468-459b-9f5e-86e85c28efed {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:21:39 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating instance_info_cache with network_info: [{"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Releasing lock "refresh_cache-b7864c94-0468-459b-9f5e-86e85c28efed" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'migration_context' on Instance uuid b7864c94-0468-459b-9f5e-86e85c28efed {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG nova.objects.base [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Object Instance<b7864c94-0468-459b-9f5e-86e85c28efed> lazy-loaded attributes: info_cache,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:21:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.466s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:40 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Deleted allocation for migration b790b8d9-e290-4287-8c60-97c98c4baa33
Nov 02 12:21:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d7e26527-53b7-4255-b852-34049bfce6da tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.567s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 3390f6a1-9306-42a3-af5a-b26e113c0b08 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid d4876f34-2e47-4d28-994d-1c6c0338b850 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 724f27de-2b8b-4bed-9509-a7b358a0f12e {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid d4101470-c263-4a46-a0cd-1abae9b9f0bb {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid b7864c94-0468-459b-9f5e-86e85c28efed {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "45b47223-abde-4927-8ad3-1389fed70985" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "45b47223-abde-4927-8ad3-1389fed70985" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-changed-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing instance network info cache due to event network-changed-0ee2046c-a1c2-4037-8d1b-377dd57da458. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] Acquiring lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] Acquired lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Refreshing network info cache for port 0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updated VIF entry in instance network info cache for port 0ee2046c-a1c2-4037-8d1b-377dd57da458. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-75b13eab-c61e-4d0f-8e9e-59225ada7cf2 req-142798d4-93ed-4c91-a3d3-20ffa74271b1 service nova] Releasing lock "refresh_cache-bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:21:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:50 user nova-compute[74534]: INFO nova.compute.manager [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Terminating instance
Nov 02 12:21:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-c07b59b3-0d26-4eca-bae2-c182891a15f2 req-469438aa-fe09-4f7a-bcfd-0b3f0f5241bd service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c07b59b3-0d26-4eca-bae2-c182891a15f2 req-469438aa-fe09-4f7a-bcfd-0b3f0f5241bd service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c07b59b3-0d26-4eca-bae2-c182891a15f2 req-469438aa-fe09-4f7a-bcfd-0b3f0f5241bd service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c07b59b3-0d26-4eca-bae2-c182891a15f2 req-469438aa-fe09-4f7a-bcfd-0b3f0f5241bd service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-c07b59b3-0d26-4eca-bae2-c182891a15f2 req-469438aa-fe09-4f7a-bcfd-0b3f0f5241bd service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-unplugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-c07b59b3-0d26-4eca-bae2-c182891a15f2 req-469438aa-fe09-4f7a-bcfd-0b3f0f5241bd service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-668d970e-373f-46fd-b749-5890363a4b5e req-3cd2a78e-dc5c-499d-bc3f-1cc04e309843 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-668d970e-373f-46fd-b749-5890363a4b5e req-3cd2a78e-dc5c-499d-bc3f-1cc04e309843 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-668d970e-373f-46fd-b749-5890363a4b5e req-3cd2a78e-dc5c-499d-bc3f-1cc04e309843 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-668d970e-373f-46fd-b749-5890363a4b5e req-3cd2a78e-dc5c-499d-bc3f-1cc04e309843 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-668d970e-373f-46fd-b749-5890363a4b5e req-3cd2a78e-dc5c-499d-bc3f-1cc04e309843 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-unplugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG nova.compute.manager [req-668d970e-373f-46fd-b749-5890363a4b5e req-3cd2a78e-dc5c-499d-bc3f-1cc04e309843 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-63c57fd1-3980-43a5-8543-8c05d7af97cd for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-6829799e-41f2-4b57-b77f-f7d1e3b48326 req-a5efee9c-1385-43df-8110-5e9b99d5cf45 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6829799e-41f2-4b57-b77f-f7d1e3b48326 req-a5efee9c-1385-43df-8110-5e9b99d5cf45 service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6829799e-41f2-4b57-b77f-f7d1e3b48326 req-a5efee9c-1385-43df-8110-5e9b99d5cf45 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6829799e-41f2-4b57-b77f-f7d1e3b48326 req-a5efee9c-1385-43df-8110-5e9b99d5cf45 service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-6829799e-41f2-4b57-b77f-f7d1e3b48326 req-a5efee9c-1385-43df-8110-5e9b99d5cf45 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-unplugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-6829799e-41f2-4b57-b77f-f7d1e3b48326 req-a5efee9c-1385-43df-8110-5e9b99d5cf45 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Instance destroyed successfully.
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lazy-loading 'resources' on Instance uuid bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:90:52,bridge_name='br-int',has_traffic_filtering=True,id=0ee2046c-a1c2-4037-8d1b-377dd57da458,network=Network(3f055cd3-0836-4480-8858-17f7acacf1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee2046c-a1') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:90:52,bridge_name='br-int',has_traffic_filtering=True,id=0ee2046c-a1c2-4037-8d1b-377dd57da458,network=Network(3f055cd3-0836-4480-8858-17f7acacf1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee2046c-a1') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee2046c-a1, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7fccea3-7317-4c76-9ffa-5b62edd8f2aa) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: INFO os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:90:52,bridge_name='br-int',has_traffic_filtering=True,id=0ee2046c-a1c2-4037-8d1b-377dd57da458,network=Network(3f055cd3-0836-4480-8858-17f7acacf1d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee2046c-a1')
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2b:b4,bridge_name='br-int',has_traffic_filtering=True,id=63c57fd1-3980-43a5-8543-8c05d7af97cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63c57fd1-39') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2b:b4,bridge_name='br-int',has_traffic_filtering=True,id=63c57fd1-3980-43a5-8543-8c05d7af97cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63c57fd1-39') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63c57fd1-39, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a32409f-1931-4c83-b884-563dd4d3350f) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: INFO os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2b:b4,bridge_name='br-int',has_traffic_filtering=True,id=63c57fd1-3980-43a5-8543-8c05d7af97cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap63c57fd1-39')
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:89:de,bridge_name='br-int',has_traffic_filtering=True,id=a90c6ff2-2c7c-4769-be62-9273d12c46cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa90c6ff2-2c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:89:de,bridge_name='br-int',has_traffic_filtering=True,id=a90c6ff2-2c7c-4769-be62-9273d12c46cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa90c6ff2-2c') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa90c6ff2-2c, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5682b74f-e86e-4840-bd07-426cdaaffc3b) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: WARNING nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-0ee2046c-a1c2-4037-8d1b-377dd57da458 for instance with vm_state active and task_state deleting.
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-unplugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-908d040c-f503-44c6-b52d-4a52152d86d9 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: WARNING nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-908d040c-f503-44c6-b52d-4a52152d86d9 for instance with vm_state active and task_state deleting.
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-unplugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-c3a06949-5196-4ffa-9cf9-448b251059d3 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: WARNING nova.compute.manager [req-9f1c1440-b7fe-482c-aa2a-54f70f5a871d req-0cbe21a0-003f-43b6-80e2-0ff12e84f64f service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-c3a06949-5196-4ffa-9cf9-448b251059d3 for instance with vm_state active and task_state deleting.
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: INFO os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:89:de,bridge_name='br-int',has_traffic_filtering=True,id=a90c6ff2-2c7c-4769-be62-9273d12c46cd,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa90c6ff2-2c')
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:7f:99,bridge_name='br-int',has_traffic_filtering=True,id=908d040c-f503-44c6-b52d-4a52152d86d9,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908d040c-f5') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:7f:99,bridge_name='br-int',has_traffic_filtering=True,id=908d040c-f503-44c6-b52d-4a52152d86d9,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908d040c-f5') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap908d040c-f5, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a478279c-a2ee-403f-9934-be73c1f59e5f) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: INFO os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:7f:99,bridge_name='br-int',has_traffic_filtering=True,id=908d040c-f503-44c6-b52d-4a52152d86d9,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908d040c-f5')
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a1:f0,bridge_name='br-int',has_traffic_filtering=True,id=c3a06949-5196-4ffa-9cf9-448b251059d3,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a06949-51') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a1:f0,bridge_name='br-int',has_traffic_filtering=True,id=c3a06949-5196-4ffa-9cf9-448b251059d3,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a06949-51') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a06949-51, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: WARNING nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-63c57fd1-3980-43a5-8543-8c05d7af97cd for instance with vm_state active and task_state deleting.
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-unplugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: WARNING nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-a90c6ff2-2c7c-4769-be62-9273d12c46cd for instance with vm_state active and task_state deleting.
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-unplugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-unplugged-088b5ee3-9557-4697-8015-042bd42946d1 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:52 user nova-compute[74534]: WARNING nova.compute.manager [req-e36f4f77-b19b-49de-9680-cdc2b00e5ea7 req-18bb99f6-3b2a-4205-9dcf-12a223a084ec service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-088b5ee3-9557-4697-8015-042bd42946d1 for instance with vm_state active and task_state deleting.
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40e2f399-556e-46a6-8b7f-ff6f01b4bfb3) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: INFO os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a1:f0,bridge_name='br-int',has_traffic_filtering=True,id=c3a06949-5196-4ffa-9cf9-448b251059d3,network=Network(5aac3c9c-0804-449f-b9c5-ace3451cec54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a06949-51')
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a433aab-09') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a433aab-09') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a433aab-09, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a8b1604-1ee6-47a4-b825-7af3d19ee8a1) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: INFO os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:3c:9e,bridge_name='br-int',has_traffic_filtering=True,id=5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a433aab-09')
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T12:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73507503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73507503',id=33,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz1CQ/4DgU73ly8PDcwhHnb6CaEYdEB3qBBzulQu649h+FX01UKJp5g67pXCNYEpz0+epOuNFPHFseOQFMGQo1GMQ8PlKI5zFbvM9Y2wLe+qTr0GRtnssDCT6/rVHJmmA==',key_name='tempest-keypair-1140224101',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844db01d167242c7ae0336faefedc180',ramdisk_id='',reservation_id='r-mrj917kg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1847001711',owner_user_name='tempest-TaggedBootDevicesTest_v242-1847001711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:20:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a4693f7b5e54a778c51c45228b31d9b',uuid=bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converting VIF {"id": "088b5ee3-9557-4697-8015-042bd42946d1", "address": "fa:16:3e:05:6e:6c", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088b5ee3-95", "ovs_interfaceid": "088b5ee3-9557-4697-8015-042bd42946d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:6c,bridge_name='br-int',has_traffic_filtering=True,id=088b5ee3-9557-4697-8015-042bd42946d1,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088b5ee3-95') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:6c,bridge_name='br-int',has_traffic_filtering=True,id=088b5ee3-9557-4697-8015-042bd42946d1,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088b5ee3-95') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap088b5ee3-95, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9352e676-930b-4b7e-8e56-28743b788153) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:21:53 user nova-compute[74534]: INFO os_vif [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:6c,bridge_name='br-int',has_traffic_filtering=True,id=088b5ee3-9557-4697-8015-042bd42946d1,network=Network(7cabd63a-7142-4de2-9ce4-426f4d863542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088b5ee3-95')
Nov 02 12:21:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJyswioX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:21:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3a404a-28de-4a5f-89bc-d7e981d06da0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]: iSNS:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]: STATIC:
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: FIRMWARE:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:21:53 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:21:53 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b65c9a5-1a4f-4b8f-8163-23d594d90318]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c34026-0fd8-4488-9c27-8169bbe573ef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180111360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477'): ({'sdh'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Removing single pathed devices sdh {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05e1aac-062c-456d-99bb-57179462952c]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c078f3b1-e331-440c-b125-e838e5e61492]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Flushing IO for device /dev/sdh {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be36a87-148d-4f82-ab57-83307786404d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25593ae-c311-4dbb-828b-5b174b0f9d82]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] SCSI volumes sdh have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6926d-c1ce-4040-a098-2b83529d1556]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3722c2-672a-4928-8fbe-1d95509576bb]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260]
Nov 02 12:21:53 user nova-compute[74534]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477, portal: 172.16.0.220,3260] successful.
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b76013-21e3-4fd7-b957-f0920f7a6477 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b2008c-d123-4452-8306-b4750ff4d08d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== disconnect_volume: return (353ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWemICkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:21:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9248c-aa67-4a67-981e-b8322f0778f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]: iSNS:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]: STATIC:
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: FIRMWARE:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:21:53 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:21:53 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75174dd-13ef-434f-8905-651a3e7c4237]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c701d4-eae5-44f8-a8d2-f45df651e5a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180111360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389'): ({'sdf'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Removing single pathed devices sdf {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a603e-6c97-48b4-b53e-32dbdcbe0a1a]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6011d2-72dc-4677-9a1c-069174f21c28]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Flushing IO for device /dev/sdf {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7571147-3a60-47bd-9f1c-33c9b8520064]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-e8dd2040-2d61-421c-931f-af986d35a1dc req-73212a16-43d6-401a-95dd-2495391ec63c service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e8dd2040-2d61-421c-931f-af986d35a1dc req-73212a16-43d6-401a-95dd-2495391ec63c service nova] Acquiring lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e8dd2040-2d61-421c-931f-af986d35a1dc req-73212a16-43d6-401a-95dd-2495391ec63c service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e8dd2040-2d61-421c-931f-af986d35a1dc req-73212a16-43d6-401a-95dd-2495391ec63c service nova] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-e8dd2040-2d61-421c-931f-af986d35a1dc req-73212a16-43d6-401a-95dd-2495391ec63c service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] No waiting events found dispatching network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:21:53 user nova-compute[74534]: WARNING nova.compute.manager [req-e8dd2040-2d61-421c-931f-af986d35a1dc req-73212a16-43d6-401a-95dd-2495391ec63c service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received unexpected event network-vif-plugged-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e for instance with vm_state active and task_state deleting.
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c90c171-fc83-47fd-8d1e-33e5109c9fbe]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] SCSI volumes sdf have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a338b04-d274-4241-bb9c-24e95abfb650]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38f19f5-ac57-44c8-92b5-93a1fef3936a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260]
Nov 02 12:21:53 user nova-compute[74534]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389, portal: 172.16.0.220,3260] successful.
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fdbf051-f126-4797-a91b-cb37db875389 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e12a19-7338-4a27-b69d-3ec8ef028d37]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== disconnect_volume: return (364ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgiDEwuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:21:53 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[91af52dd-0112-41d9-b77a-2afb4b45dab8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]: iSNS:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]: STATIC:
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:21:53 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:21:53 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:21:53 user nova-compute[74534]: FIRMWARE:
Nov 02 12:21:53 user nova-compute[74534]: No targets found.
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:21:53 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:21:53 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e217dd4-9b62-4352-bf44-561bb8006c5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b609e73-be88-4b24-a08c-41dd11c3b0f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:21:53 user nova-compute[74534]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb (non-flash)
Nov 02 12:21:53 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c5ee320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb'): ({'sdg'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Removing single pathed devices sdg {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18487c2-1f37-4da9-94fa-cb6e8e500edc]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a5f504-bd9f-4492-9a9b-878167d75450]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Flushing IO for device /dev/sdg {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc86a8c-74a6-499c-94fd-3132206c095f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2595a0-c658-4e14-b4b0-fd0aec825f9d]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] SCSI volumes sdg have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deafb1d-e857-4de9-976f-63d4e4aad4af]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:53 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[75478962-7aa1-408c-ad3d-926b34a2afe7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260]
Nov 02 12:21:54 user nova-compute[74534]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb, portal: 172.16.0.220,3260] successful.
Nov 02 12:21:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6618bef-361d-4b05-8cb1-c3f031dc6fbb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c5fe2f-cdb6-4e4f-909a-4d4e13ec6c68]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] <== disconnect_volume: return (340ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:21:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Deleting instance files /opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3_del
Nov 02 12:21:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Deletion of /opt/stack/data/nova/instances/bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3_del complete
Nov 02 12:21:54 user nova-compute[74534]: INFO nova.compute.manager [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Took 3.81 seconds to destroy the instance on the hypervisor.
Nov 02 12:21:54 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:21:54 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:21:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-a4502955-017e-47a5-aad1-5186f8149a30 req-b45a26e5-848c-46af-bfd0-cb97dc87efca service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-deleted-088b5ee3-9557-4697-8015-042bd42946d1 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:55 user nova-compute[74534]: INFO nova.compute.manager [req-a4502955-017e-47a5-aad1-5186f8149a30 req-b45a26e5-848c-46af-bfd0-cb97dc87efca service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Neutron deleted interface 088b5ee3-9557-4697-8015-042bd42946d1; detaching it from the instance and deleting it from the info cache
Nov 02 12:21:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-a4502955-017e-47a5-aad1-5186f8149a30 req-b45a26e5-848c-46af-bfd0-cb97dc87efca service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "908d040c-f503-44c6-b52d-4a52152d86d9", "address": "fa:16:3e:7d:7f:99", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908d040c-f5", "ovs_interfaceid": "908d040c-f503-44c6-b52d-4a52152d86d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-a4502955-017e-47a5-aad1-5186f8149a30 req-b45a26e5-848c-46af-bfd0-cb97dc87efca service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Detach interface failed, port_id=088b5ee3-9557-4697-8015-042bd42946d1, reason: Instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:21:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-deleted-908d040c-f503-44c6-b52d-4a52152d86d9 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:57 user nova-compute[74534]: INFO nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Neutron deleted interface 908d040c-f503-44c6-b52d-4a52152d86d9; detaching it from the instance and deleting it from the info cache
Nov 02 12:21:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "address": "fa:16:3e:76:90:52", "network": {"id": "3f055cd3-0836-4480-8858-17f7acacf1d7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-260843906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee2046c-a1", "ovs_interfaceid": "0ee2046c-a1c2-4037-8d1b-377dd57da458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Detach interface failed, port_id=908d040c-f503-44c6-b52d-4a52152d86d9, reason: Instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:21:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-deleted-0ee2046c-a1c2-4037-8d1b-377dd57da458 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:57 user nova-compute[74534]: INFO nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Neutron deleted interface 0ee2046c-a1c2-4037-8d1b-377dd57da458; detaching it from the instance and deleting it from the info cache
Nov 02 12:21:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3a06949-5196-4ffa-9cf9-448b251059d3", "address": "fa:16:3e:98:a1:f0", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a06949-51", "ovs_interfaceid": "c3a06949-5196-4ffa-9cf9-448b251059d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:21:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Detach interface failed, port_id=0ee2046c-a1c2-4037-8d1b-377dd57da458, reason: Instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:21:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-deleted-c3a06949-5196-4ffa-9cf9-448b251059d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:21:58 user nova-compute[74534]: INFO nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Neutron deleted interface c3a06949-5196-4ffa-9cf9-448b251059d3; detaching it from the instance and deleting it from the info cache
Nov 02 12:21:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [{"id": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "address": "fa:16:3e:cc:2b:b4", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63c57fd1-39", "ovs_interfaceid": "63c57fd1-3980-43a5-8543-8c05d7af97cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "address": "fa:16:3e:6f:89:de", "network": {"id": "5aac3c9c-0804-449f-b9c5-ace3451cec54", "bridge": "br-int", "label": "tempest-device-tagging-net1-1133970863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa90c6ff2-2c", "ovs_interfaceid": "a90c6ff2-2c7c-4769-be62-9273d12c46cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "address": "fa:16:3e:e9:3c:9e", "network": {"id": "7cabd63a-7142-4de2-9ce4-426f4d863542", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224577577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "844db01d167242c7ae0336faefedc180", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a433aab-09", "ovs_interfaceid": "5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-244354c6-69ce-433d-86f8-7ce24fb61a1f req-f7828e42-27bf-4b7d-8261-4ee6f3ba69a6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Detach interface failed, port_id=c3a06949-5196-4ffa-9cf9-448b251059d3, reason: Instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:21:58 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:21:58 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Took 4.16 seconds to deallocate network for instance.
Nov 02 12:21:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-cc4213dc-6b9b-490e-b9b7-6832c54c836b req-cd1571d5-b29d-415d-9608-1d5a20f618b6 service nova] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Received event network-vif-deleted-5a433aab-0981-48bc-a7fd-d5ea9ffc5c9e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:01 user nova-compute[74534]: INFO nova.compute.manager [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] [instance: bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3] Took 3.08 seconds to detach 3 volumes for instance.
Nov 02 12:22:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:01 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:22:01 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:22:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:01 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Deleted allocations for instance bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3
Nov 02 12:22:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4101249-c2a7-4d22-8965-4f3642a67e9f tempest-TaggedBootDevicesTest_v242-1847001711 tempest-TaggedBootDevicesTest_v242-1847001711-project-member] Lock "bd2c0f0b-46ca-46b7-9a05-68ce0fc2a3d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.694s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:22:11 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7782MB free_disk=24.98300552368164GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1b445fab-5562-418a-b14a-d25da40f3fc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:22:11 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:22:12 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:22:12 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:22:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:22:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [{"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-d4876f34-2e47-4d28-994d-1c6c0338b850" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:22:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:22:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing instance network info cache due to event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:22:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:22:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:22:16 user nova-compute[74534]: DEBUG nova.network.neutron [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:22:17 user nova-compute[74534]: DEBUG nova.network.neutron [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updated VIF entry in instance network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:22:17 user nova-compute[74534]: DEBUG nova.network.neutron [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:22:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-042988ab-bb8b-4431-b084-7a8f9a96f458 req-8d2ff22e-7cf0-4311-8fb2-9fee7c402bfc service nova] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG nova.objects.instance [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'flavor' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:18 user nova-compute[74534]: INFO nova.compute.manager [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Attaching volume 60d8aca4-7b65-4616-8a41-497abe0778af to /dev/vdb
Nov 02 12:22:18 user nova-compute[74534]: DEBUG os_brick.utils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c27e243-8b98-497f-90a1-86052bd697e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4b5b86-807f-4520-acee-75ca3f3dc899]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3efd192-d645-411b-99a7-b008dd89f082]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a763e8c0-bb98-4fb9-8360-91dd8aae0705]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:22:18 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:22:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d80f751-4425-4a32-bfa1-df6079749925]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG os_brick.utils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating existing volume attachment record: f4e28f12-be0a-462a-90be-c077edad541b {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:22:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyWQMhHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:22:40 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:22:40 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:22:40 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57701d3-1ce7-4b82-b2e0-94ee1be02a07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:22:40 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da99c0c-4c9a-4730-a4c1-ea291c7d2bc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af] added
Nov 02 12:22:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28daa1b-9cce-4a81-82c6-aaf2a9c88f7c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a64dde-3ed5-4ade-9880-3b5e9122b1d4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyWQMhHG {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyWQMhHG" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453ba06-b51a-494b-891c-1e71cf801b4c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jyWQMhHG'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[886c23ec-1172-4ab5-acb8-1181fc7095ec]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b8e3d9-d8b8-48f3-89d7-10bc325dbe69]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[908c1928-b248-4c32-a83f-9acc0d9daec4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260]
Nov 02 12:22:41 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260] successful.
Nov 02 12:22:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc8732-d7b8-41d2-9bef-1c1c1b3fd455]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcdbf22-44b3-4b67-a3d3-fc18aa855d9f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:22:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:22:41 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:22:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8c8ec8-d479-4ee8-988b-17916ee5dad9]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:22:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyWQMhHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "59fa8566-78ea-4809-87f5-d94eb9091d55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26362383366613762', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383366613762', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.objects.instance [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'flavor' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:22:42 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:22:42 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:22:42 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:22:42 user nova-compute[74534]:   <serial>60d8aca4-7b65-4616-8a41-497abe0778af</serial>
Nov 02 12:22:42 user nova-compute[74534]: </disk>
Nov 02 12:22:42 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:22:42 user nova-compute[74534]: INFO nova.compute.claims [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Claim successful on node user
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No VIF found with MAC fa:16:3e:ac:cf:7b, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-763459a5-fba0-4dd8-9bf6-c96260df4901 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.481s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:22:42 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:22:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG nova.policy [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02e319e817cc49a5af2d18d01ab590b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0644a4713b634b68ba79e5beb0d4211b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:22:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Creating image(s)
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "/opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "/opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "/opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.225s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk 1073741824" returned: 0 in 0.062s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:43 user nova-compute[74534]: INFO nova.compute.manager [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Rescuing
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.266s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:22:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Cannot resize image /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Ensure instance console log exists: /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Successfully created port: a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-2a287be4-6bfe-446c-92b0-2d6fb6be431b req-c1171783-e0aa-45ab-9b22-61b6ab1f5ccf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2a287be4-6bfe-446c-92b0-2d6fb6be431b req-c1171783-e0aa-45ab-9b22-61b6ab1f5ccf service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2a287be4-6bfe-446c-92b0-2d6fb6be431b req-c1171783-e0aa-45ab-9b22-61b6ab1f5ccf service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2a287be4-6bfe-446c-92b0-2d6fb6be431b req-c1171783-e0aa-45ab-9b22-61b6ab1f5ccf service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-2a287be4-6bfe-446c-92b0-2d6fb6be431b req-c1171783-e0aa-45ab-9b22-61b6ab1f5ccf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:45 user nova-compute[74534]: WARNING nova.compute.manager [req-2a287be4-6bfe-446c-92b0-2d6fb6be431b req-c1171783-e0aa-45ab-9b22-61b6ab1f5ccf service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state active and task_state rescuing.
Nov 02 12:22:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance destroyed successfully.
Nov 02 12:22:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Attempting rescue
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74534) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance directory exists: not creating {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 12:22:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Creating image(s)
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue" returned: 0 in 0.064s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'migration_context' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.base [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<1b445fab-5562-418a-b14a-d25da40f3fc1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Start _get_guest_xml network_info=[{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:ac:cf:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36642543-2106-4841-8acf-2e35b58c4209', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'resources' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.base [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<1b445fab-5562-418a-b14a-d25da40f3fc1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'numa_topology' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.base [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<1b445fab-5562-418a-b14a-d25da40f3fc1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:22:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:22:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Successfully updated port: a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.base [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<1b445fab-5562-418a-b14a-d25da40f3fc1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2096656522',display_name='tempest-ServerRescueNegativeTestJSON-server-2096656522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2096656522',id=34,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwBvnAFBaomGwtXuR0NJ8EhEfw65vBp4jQPxtgOkXGSyhXiIkLJnbT9dVjv6sat647ZUyfRWtGQxP50/jmy14imFFE3MhsD15fHSOQtWHVu73D30wcZ7sqQzS5lGVFZ6w==',key_name='tempest-keypair-1795761394',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:20:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-p0jltjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=1b445fab-5562-418a-b14a-d25da40f3fc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:ac:cf:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "vif_mac": "fa:16:3e:ac:cf:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "refresh_cache-59fa8566-78ea-4809-87f5-d94eb9091d55" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquired lock "refresh_cache-59fa8566-78ea-4809-87f5-d94eb9091d55" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.objects.base [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Object Instance<1b445fab-5562-418a-b14a-d25da40f3fc1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:22:45 user nova-compute[74534]:   <uuid>1b445fab-5562-418a-b14a-d25da40f3fc1</uuid>
Nov 02 12:22:45 user nova-compute[74534]:   <name>instance-00000022</name>
Nov 02 12:22:45 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:22:45 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:22:45 user nova-compute[74534]:   <metadata>
Nov 02 12:22:45 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:22:45 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:22:45 user nova-compute[74534]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2096656522</nova:name>
Nov 02 12:22:45 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:22:45</nova:creationTime>
Nov 02 12:22:45 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:22:45 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:22:45 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:22:45 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:22:45 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:22:45 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:22:45 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:22:45 user nova-compute[74534]:       <nova:owner>
Nov 02 12:22:45 user nova-compute[74534]:         <nova:user uuid="c0dabe5e283645a382a1f0bf6ab7ddf1">tempest-ServerRescueNegativeTestJSON-158551613-project-member</nova:user>
Nov 02 12:22:45 user nova-compute[74534]:         <nova:project uuid="294df1c916c248d496812d8b2bb1b57e">tempest-ServerRescueNegativeTestJSON-158551613</nova:project>
Nov 02 12:22:45 user nova-compute[74534]:       </nova:owner>
Nov 02 12:22:45 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:22:45 user nova-compute[74534]:       <nova:ports>
Nov 02 12:22:45 user nova-compute[74534]:         <nova:port uuid="89e9cb38-0ab9-44e6-8ec3-5afabcd4c169">
Nov 02 12:22:45 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:22:45 user nova-compute[74534]:         </nova:port>
Nov 02 12:22:45 user nova-compute[74534]:       </nova:ports>
Nov 02 12:22:45 user nova-compute[74534]:     </nova:instance>
Nov 02 12:22:45 user nova-compute[74534]:   </metadata>
Nov 02 12:22:45 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:22:45 user nova-compute[74534]:     <system>
Nov 02 12:22:45 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:22:45 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:22:45 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:22:45 user nova-compute[74534]:       <entry name="serial">1b445fab-5562-418a-b14a-d25da40f3fc1</entry>
Nov 02 12:22:45 user nova-compute[74534]:       <entry name="uuid">1b445fab-5562-418a-b14a-d25da40f3fc1</entry>
Nov 02 12:22:45 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:22:45 user nova-compute[74534]:     </system>
Nov 02 12:22:45 user nova-compute[74534]:   </sysinfo>
Nov 02 12:22:45 user nova-compute[74534]:   <os>
Nov 02 12:22:45 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:22:45 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:22:45 user nova-compute[74534]:   </os>
Nov 02 12:22:45 user nova-compute[74534]:   <features>
Nov 02 12:22:45 user nova-compute[74534]:     <acpi/>
Nov 02 12:22:45 user nova-compute[74534]:     <apic/>
Nov 02 12:22:45 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:22:45 user nova-compute[74534]:   </features>
Nov 02 12:22:45 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:22:45 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:22:45 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:22:45 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:22:45 user nova-compute[74534]:   </clock>
Nov 02 12:22:45 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:22:45 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:22:45 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:22:45 user nova-compute[74534]:   </cpu>
Nov 02 12:22:45 user nova-compute[74534]:   <devices>
Nov 02 12:22:45 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:22:45 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:22:45 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue"/>
Nov 02 12:22:45 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:22:45 user nova-compute[74534]:     </disk>
Nov 02 12:22:45 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:22:45 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:22:45 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk"/>
Nov 02 12:22:45 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:22:45 user nova-compute[74534]:     </disk>
Nov 02 12:22:45 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:22:45 user nova-compute[74534]:       <mac address="fa:16:3e:ac:cf:7b"/>
Nov 02 12:22:45 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:22:45 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:22:45 user nova-compute[74534]:       <target dev="tap89e9cb38-0a"/>
Nov 02 12:22:45 user nova-compute[74534]:     </interface>
Nov 02 12:22:45 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:22:45 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/console.log" append="off"/>
Nov 02 12:22:45 user nova-compute[74534]:     </serial>
Nov 02 12:22:45 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:22:45 user nova-compute[74534]:     <video>
Nov 02 12:22:45 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:22:45 user nova-compute[74534]:     </video>
Nov 02 12:22:45 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:22:45 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:22:45 user nova-compute[74534]:     </rng>
Nov 02 12:22:45 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:22:45 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:22:45 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:22:45 user nova-compute[74534]:     </memballoon>
Nov 02 12:22:45 user nova-compute[74534]:   </devices>
Nov 02 12:22:45 user nova-compute[74534]: </domain>
Nov 02 12:22:45 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:22:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance destroyed successfully.
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] No VIF found with MAC fa:16:3e:ac:cf:7b, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Updating instance_info_cache with network_info: [{"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Releasing lock "refresh_cache-59fa8566-78ea-4809-87f5-d94eb9091d55" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Instance network_info: |[{"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Start _get_guest_xml network_info=[{"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:22:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:22:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:22:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:22:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-519914117',display_name='tempest-VolumesNegativeTest-instance-519914117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-519914117',id=35,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0644a4713b634b68ba79e5beb0d4211b',ramdisk_id='',reservation_id='r-78ap6rqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-845020160',owner_user_name='tempest-VolumesNegativeTest-845020160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:22:43Z,user_data=None,user_id='02e319e817cc49a5af2d18d01ab590b6',uuid=59fa8566-78ea-4809-87f5-d94eb9091d55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Converting VIF {"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=a5e4b776-323b-4fe0-b784-0c6097b9dd37,network=Network(ccec35f0-c0e4-4658-8ff5-3d4185a49db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e4b776-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.objects.instance [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lazy-loading 'pci_devices' on Instance uuid 59fa8566-78ea-4809-87f5-d94eb9091d55 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:22:46 user nova-compute[74534]:   <uuid>59fa8566-78ea-4809-87f5-d94eb9091d55</uuid>
Nov 02 12:22:46 user nova-compute[74534]:   <name>instance-00000023</name>
Nov 02 12:22:46 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:22:46 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:22:46 user nova-compute[74534]:   <metadata>
Nov 02 12:22:46 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:22:46 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:22:46 user nova-compute[74534]:       <nova:name>tempest-VolumesNegativeTest-instance-519914117</nova:name>
Nov 02 12:22:46 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:22:45</nova:creationTime>
Nov 02 12:22:46 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:22:46 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:22:46 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:22:46 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:22:46 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:22:46 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:22:46 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:22:46 user nova-compute[74534]:       <nova:owner>
Nov 02 12:22:46 user nova-compute[74534]:         <nova:user uuid="02e319e817cc49a5af2d18d01ab590b6">tempest-VolumesNegativeTest-845020160-project-member</nova:user>
Nov 02 12:22:46 user nova-compute[74534]:         <nova:project uuid="0644a4713b634b68ba79e5beb0d4211b">tempest-VolumesNegativeTest-845020160</nova:project>
Nov 02 12:22:46 user nova-compute[74534]:       </nova:owner>
Nov 02 12:22:46 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:22:46 user nova-compute[74534]:       <nova:ports>
Nov 02 12:22:46 user nova-compute[74534]:         <nova:port uuid="a5e4b776-323b-4fe0-b784-0c6097b9dd37">
Nov 02 12:22:46 user nova-compute[74534]:           <nova:ip type="fixed" address="192.168.233.99" ipVersion="4"/>
Nov 02 12:22:46 user nova-compute[74534]:         </nova:port>
Nov 02 12:22:46 user nova-compute[74534]:       </nova:ports>
Nov 02 12:22:46 user nova-compute[74534]:     </nova:instance>
Nov 02 12:22:46 user nova-compute[74534]:   </metadata>
Nov 02 12:22:46 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:22:46 user nova-compute[74534]:     <system>
Nov 02 12:22:46 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:22:46 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:22:46 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:22:46 user nova-compute[74534]:       <entry name="serial">59fa8566-78ea-4809-87f5-d94eb9091d55</entry>
Nov 02 12:22:46 user nova-compute[74534]:       <entry name="uuid">59fa8566-78ea-4809-87f5-d94eb9091d55</entry>
Nov 02 12:22:46 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:22:46 user nova-compute[74534]:     </system>
Nov 02 12:22:46 user nova-compute[74534]:   </sysinfo>
Nov 02 12:22:46 user nova-compute[74534]:   <os>
Nov 02 12:22:46 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:22:46 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:22:46 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:22:46 user nova-compute[74534]:   </os>
Nov 02 12:22:46 user nova-compute[74534]:   <features>
Nov 02 12:22:46 user nova-compute[74534]:     <acpi/>
Nov 02 12:22:46 user nova-compute[74534]:     <apic/>
Nov 02 12:22:46 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:22:46 user nova-compute[74534]:   </features>
Nov 02 12:22:46 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:22:46 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:22:46 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:22:46 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:22:46 user nova-compute[74534]:   </clock>
Nov 02 12:22:46 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:22:46 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:22:46 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:22:46 user nova-compute[74534]:   </cpu>
Nov 02 12:22:46 user nova-compute[74534]:   <devices>
Nov 02 12:22:46 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:22:46 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:22:46 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk"/>
Nov 02 12:22:46 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:22:46 user nova-compute[74534]:     </disk>
Nov 02 12:22:46 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:22:46 user nova-compute[74534]:       <mac address="fa:16:3e:ca:7d:77"/>
Nov 02 12:22:46 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:22:46 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:22:46 user nova-compute[74534]:       <target dev="tapa5e4b776-32"/>
Nov 02 12:22:46 user nova-compute[74534]:     </interface>
Nov 02 12:22:46 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:22:46 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/console.log" append="off"/>
Nov 02 12:22:46 user nova-compute[74534]:     </serial>
Nov 02 12:22:46 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:22:46 user nova-compute[74534]:     <video>
Nov 02 12:22:46 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:22:46 user nova-compute[74534]:     </video>
Nov 02 12:22:46 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:22:46 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:22:46 user nova-compute[74534]:     </rng>
Nov 02 12:22:46 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:22:46 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:22:46 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:22:46 user nova-compute[74534]:     </memballoon>
Nov 02 12:22:46 user nova-compute[74534]:   </devices>
Nov 02 12:22:46 user nova-compute[74534]: </domain>
Nov 02 12:22:46 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:22:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-519914117',display_name='tempest-VolumesNegativeTest-instance-519914117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-519914117',id=35,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0644a4713b634b68ba79e5beb0d4211b',ramdisk_id='',reservation_id='r-78ap6rqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-845020160',owner_user_name='tempest-VolumesNegativeTest-845020160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:22:43Z,user_data=None,user_id='02e319e817cc49a5af2d18d01ab590b6',uuid=59fa8566-78ea-4809-87f5-d94eb9091d55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Converting VIF {"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=a5e4b776-323b-4fe0-b784-0c6097b9dd37,network=Network(ccec35f0-c0e4-4658-8ff5-3d4185a49db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e4b776-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG os_vif [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=a5e4b776-323b-4fe0-b784-0c6097b9dd37,network=Network(ccec35f0-c0e4-4658-8ff5-3d4185a49db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e4b776-32') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a6227ec-9dba-5c59-9b2b-e93e0f3cacc5', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5e4b776-32, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5e4b776-32, col_values=(('qos', UUID('4e063dba-c6a5-4e6a-9dc3-f523ab87ae52')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5e4b776-32, col_values=(('external_ids', {'iface-id': 'a5e4b776-323b-4fe0-b784-0c6097b9dd37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:7d:77', 'vm-uuid': '59fa8566-78ea-4809-87f5-d94eb9091d55'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:46 user nova-compute[74534]: INFO os_vif [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=a5e4b776-323b-4fe0-b784-0c6097b9dd37,network=Network(ccec35f0-c0e4-4658-8ff5-3d4185a49db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e4b776-32')
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:22:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] No VIF found with MAC fa:16:3e:ca:7d:77, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:47 user nova-compute[74534]: WARNING nova.compute.manager [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state active and task_state rescuing.
Nov 02 12:22:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received event network-changed-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Refreshing instance network info cache due to event network-changed-a5e4b776-323b-4fe0-b784-0c6097b9dd37. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] Acquiring lock "refresh_cache-59fa8566-78ea-4809-87f5-d94eb9091d55" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] Acquired lock "refresh_cache-59fa8566-78ea-4809-87f5-d94eb9091d55" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG nova.network.neutron [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Refreshing network info cache for port a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG nova.network.neutron [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Updated VIF entry in instance network info cache for port a5e4b776-323b-4fe0-b784-0c6097b9dd37. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG nova.network.neutron [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Updating instance_info_cache with network_info: [{"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:22:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab05eacd-b4e6-40a5-b9a1-95c17c085c98 req-5ddffc58-8f78-472f-bbad-69a877d21e35 service nova] Releasing lock "refresh_cache-59fa8566-78ea-4809-87f5-d94eb9091d55" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:49 user nova-compute[74534]: WARNING nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state active and task_state rescuing.
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:49 user nova-compute[74534]: WARNING nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state active and task_state rescuing.
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received event network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Acquiring lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] No waiting events found dispatching network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:49 user nova-compute[74534]: WARNING nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received unexpected event network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 for instance with vm_state building and task_state spawning.
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received event network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Acquiring lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] No waiting events found dispatching network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:49 user nova-compute[74534]: WARNING nova.compute.manager [req-320af0c4-8ff0-4a4c-bd72-0b3e255c25a9 req-bc7db97d-2ba4-44f0-a67e-2901a8727859 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received unexpected event network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 for instance with vm_state building and task_state spawning.
Nov 02 12:22:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:22:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:22:50 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Instance spawned successfully.
Nov 02 12:22:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:22:51 user nova-compute[74534]: INFO nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-144815b0-aa4c-4060-b5ac-6928dd352ed8 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:22:51 user nova-compute[74534]: INFO nova.compute.manager [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Took 8.95 seconds to build instance.
Nov 02 12:22:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4264ab11-eac8-4155-8585-a540e087ffee tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.069s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:56 user nova-compute[74534]: INFO nova.compute.manager [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Terminating instance
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-d6ed93d7-e87e-497d-b501-fc27d57f6d93 req-60964e3d-a25f-42a0-bee5-bb6aca0db103 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d6ed93d7-e87e-497d-b501-fc27d57f6d93 req-60964e3d-a25f-42a0-bee5-bb6aca0db103 service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d6ed93d7-e87e-497d-b501-fc27d57f6d93 req-60964e3d-a25f-42a0-bee5-bb6aca0db103 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d6ed93d7-e87e-497d-b501-fc27d57f6d93 req-60964e3d-a25f-42a0-bee5-bb6aca0db103 service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-d6ed93d7-e87e-497d-b501-fc27d57f6d93 req-60964e3d-a25f-42a0-bee5-bb6aca0db103 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-d6ed93d7-e87e-497d-b501-fc27d57f6d93 req-60964e3d-a25f-42a0-bee5-bb6aca0db103 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-unplugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Instance destroyed successfully.
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'resources' on Instance uuid 1dd3521d-944a-4d86-bcf5-d5988b6f923c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2052723514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2052723514',id=30,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-bg38yprw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:21:10Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=1dd3521d-944a-4d86-bcf5-d5988b6f923c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "dc473798-99ef-4267-9840-e445a25d7322", "address": "fa:16:3e:04:cc:52", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc473798-99", "ovs_interfaceid": "dc473798-99ef-4267-9840-e445a25d7322", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG os_vif [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc473798-99, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:22:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85ee11dd-46b1-4199-aad4-e916827a2e1d) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:22:57 user nova-compute[74534]: INFO os_vif [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:cc:52,bridge_name='br-int',has_traffic_filtering=True,id=dc473798-99ef-4267-9840-e445a25d7322,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc473798-99')
Nov 02 12:22:57 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuTgXEUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:22:57 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[341e7d17-ecfc-4f32-9095-8c18184ef1a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:22:57 user nova-compute[74534]: No targets found.
Nov 02 12:22:57 user nova-compute[74534]: iSNS:
Nov 02 12:22:57 user nova-compute[74534]: No targets found.
Nov 02 12:22:57 user nova-compute[74534]: STATIC:
Nov 02 12:22:57 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb
Nov 02 12:22:57 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:22:57 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:22:57 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:22:57 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:22:57 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:22:57 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:22:57 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:22:57 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:22:57 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af
Nov 02 12:22:57 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:22:57 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:22:57 user nova-compute[74534]: FIRMWARE:
Nov 02 12:22:57 user nova-compute[74534]: No targets found.
Nov 02 12:22:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:22:57 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:22:57 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6445feb3-dbd9-4660-88ea-7c9627e08bc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[61818e64-cf66-42b5-a5a6-29a5d2f7c3ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:22:57 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:22:57 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:22:57 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:22:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:22:57 user nova-compute[74534]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb (non-flash)
Nov 02 12:22:57 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:22:57 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:22:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180763370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b0c3a-c480-427e-b277-b48731d08adc]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfae9ed-bc30-43b7-92d1-e3a5ff43d898]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0553e5-22c9-4748-a2ef-0989f185fa32]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec540aa-335a-4c99-bcce-3767e6e4b7f2]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f0790979', '/dev/disk/by-id/scsi-1SCST_BIOf0790979-daf9619ddca011e5', '/dev/disk/by-id/scsi-26461663936313964') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeaec80-3258-4ab9-8f59-46b3f2ffe101]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f3c9c9-9ea8-4208-ba30-a21cb65bf2d5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8283e50-5f71-4d66-852b-f99cb3d80adc]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260]
Nov 02 12:22:57 user nova-compute[74534]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb, portal: 172.16.0.220,3260] successful.
Nov 02 12:22:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6225913-83b4-42e7-90cd-57cdab9676bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb47f76-bd0d-4103-88ba-84b37fb7c336]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== disconnect_volume: return (398ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:22:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Deleting instance files /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c_del
Nov 02 12:22:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Deletion of /opt/stack/data/nova/instances/1dd3521d-944a-4d86-bcf5-d5988b6f923c_del complete
Nov 02 12:22:57 user nova-compute[74534]: INFO nova.compute.manager [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 02 12:22:57 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:22:57 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:22:58 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:22:58 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Took 0.55 seconds to deallocate network for instance.
Nov 02 12:22:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-1706f69a-938f-439c-b6fe-f2f43604ee17 req-46d48580-3ed9-44ff-882b-a7481541fd71 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-deleted-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:58 user nova-compute[74534]: INFO nova.compute.manager [req-1706f69a-938f-439c-b6fe-f2f43604ee17 req-46d48580-3ed9-44ff-882b-a7481541fd71 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Neutron deleted interface dc473798-99ef-4267-9840-e445a25d7322; detaching it from the instance and deleting it from the info cache
Nov 02 12:22:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-1706f69a-938f-439c-b6fe-f2f43604ee17 req-46d48580-3ed9-44ff-882b-a7481541fd71 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:22:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-1706f69a-938f-439c-b6fe-f2f43604ee17 req-46d48580-3ed9-44ff-882b-a7481541fd71 service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Detach interface failed, port_id=dc473798-99ef-4267-9840-e445a25d7322, reason: Instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:22:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-ea3d6a4f-1186-4e09-bc13-4818390e3ecb req-862992d0-e4d7-4ea9-b4a2-e3efd03a5b9c service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:22:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea3d6a4f-1186-4e09-bc13-4818390e3ecb req-862992d0-e4d7-4ea9-b4a2-e3efd03a5b9c service nova] Acquiring lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea3d6a4f-1186-4e09-bc13-4818390e3ecb req-862992d0-e4d7-4ea9-b4a2-e3efd03a5b9c service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea3d6a4f-1186-4e09-bc13-4818390e3ecb req-862992d0-e4d7-4ea9-b4a2-e3efd03a5b9c service nova] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-ea3d6a4f-1186-4e09-bc13-4818390e3ecb req-862992d0-e4d7-4ea9-b4a2-e3efd03a5b9c service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] No waiting events found dispatching network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:22:58 user nova-compute[74534]: WARNING nova.compute.manager [req-ea3d6a4f-1186-4e09-bc13-4818390e3ecb req-862992d0-e4d7-4ea9-b4a2-e3efd03a5b9c service nova] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Received unexpected event network-vif-plugged-dc473798-99ef-4267-9840-e445a25d7322 for instance with vm_state active and task_state deleting.
Nov 02 12:22:59 user nova-compute[74534]: INFO nova.compute.manager [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 1dd3521d-944a-4d86-bcf5-d5988b6f923c] Took 0.96 seconds to detach 1 volumes for instance.
Nov 02 12:22:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:22:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:22:59 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:22:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:22:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:22:59 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Deleted allocations for instance 1dd3521d-944a-4d86-bcf5-d5988b6f923c
Nov 02 12:22:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fb29a6a0-a1bc-4450-922a-7685afb1ba6e tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "1dd3521d-944a-4d86-bcf5-d5988b6f923c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.535s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:23:08 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:09 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:23:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:23:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:23:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:23:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=7732MB free_disk=24.942474365234375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:23:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 724f27de-2b8b-4bed-9509-a7b358a0f12e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1b445fab-5562-418a-b14a-d25da40f3fc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 59fa8566-78ea-4809-87f5-d94eb9091d55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:23:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.866s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:23:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:23:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:23:15 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating instance_info_cache with network_info: [{"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-45b47223-abde-4927-8ad3-1389fed70985" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:16 user nova-compute[74534]: INFO nova.compute.manager [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Terminating instance
Nov 02 12:23:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-1f748356-f8bf-446b-9866-ad38a2f04960 req-66185675-4475-4462-8ae7-003c089beafe service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received event network-vif-unplugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1f748356-f8bf-446b-9866-ad38a2f04960 req-66185675-4475-4462-8ae7-003c089beafe service nova] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1f748356-f8bf-446b-9866-ad38a2f04960 req-66185675-4475-4462-8ae7-003c089beafe service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1f748356-f8bf-446b-9866-ad38a2f04960 req-66185675-4475-4462-8ae7-003c089beafe service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-1f748356-f8bf-446b-9866-ad38a2f04960 req-66185675-4475-4462-8ae7-003c089beafe service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] No waiting events found dispatching network-vif-unplugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:23:16 user nova-compute[74534]: DEBUG nova.compute.manager [req-1f748356-f8bf-446b-9866-ad38a2f04960 req-66185675-4475-4462-8ae7-003c089beafe service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received event network-vif-unplugged-0832c3fe-7b08-4377-a288-a6c58b555f4b for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:17 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Instance destroyed successfully.
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.objects.instance [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lazy-loading 'resources' on Instance uuid d4101470-c263-4a46-a0cd-1abae9b9f0bb {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1747017501',display_name='tempest-ServersNegativeTestJSON-server-1747017501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1747017501',id=25,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:14:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38c4b94f48eb458589f03332ebb35a87',ramdisk_id='',reservation_id='r-zj5yy3e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1439847488',owner_user_name='tempest-ServersNegativeTestJSON-1439847488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:14:20Z,user_data=None,user_id='dae37e0cfa414111b89952d130d4fbf2',uuid=d4101470-c263-4a46-a0cd-1abae9b9f0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converting VIF {"id": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "address": "fa:16:3e:b8:a0:f0", "network": {"id": "8c924b04-901c-498d-8e3c-06bd27ef6ed5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-85473590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38c4b94f48eb458589f03332ebb35a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0832c3fe-7b", "ovs_interfaceid": "0832c3fe-7b08-4377-a288-a6c58b555f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=0832c3fe-7b08-4377-a288-a6c58b555f4b,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0832c3fe-7b') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG os_vif [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=0832c3fe-7b08-4377-a288-a6c58b555f4b,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0832c3fe-7b') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0832c3fe-7b, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=655561da-0025-4957-8269-0dd4a6a6e0aa) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:17 user nova-compute[74534]: INFO os_vif [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=0832c3fe-7b08-4377-a288-a6c58b555f4b,network=Network(8c924b04-901c-498d-8e3c-06bd27ef6ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0832c3fe-7b')
Nov 02 12:23:17 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Deleting instance files /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb_del
Nov 02 12:23:17 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Deletion of /opt/stack/data/nova/instances/d4101470-c263-4a46-a0cd-1abae9b9f0bb_del complete
Nov 02 12:23:17 user nova-compute[74534]: INFO nova.compute.manager [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 02 12:23:17 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:23:17 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Took 0.54 seconds to deallocate network for instance.
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-ef00e549-0012-4b9b-b2f2-b334331d4652 req-0c832eda-e8f9-4289-a6cd-aecadc2f8486 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received event network-vif-deleted-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:23:17 user nova-compute[74534]: INFO nova.compute.manager [req-ef00e549-0012-4b9b-b2f2-b334331d4652 req-0c832eda-e8f9-4289-a6cd-aecadc2f8486 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Neutron deleted interface 0832c3fe-7b08-4377-a288-a6c58b555f4b; detaching it from the instance and deleting it from the info cache
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.network.neutron [req-ef00e549-0012-4b9b-b2f2-b334331d4652 req-0c832eda-e8f9-4289-a6cd-aecadc2f8486 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-ef00e549-0012-4b9b-b2f2-b334331d4652 req-0c832eda-e8f9-4289-a6cd-aecadc2f8486 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Detach interface failed, port_id=0832c3fe-7b08-4377-a288-a6c58b555f4b, reason: Instance d4101470-c263-4a46-a0cd-1abae9b9f0bb could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:18 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Deleted allocations for instance d4101470-c263-4a46-a0cd-1abae9b9f0bb
Nov 02 12:23:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-55c7d8de-5ea0-4fd4-92b3-08056d1960de tempest-ServersNegativeTestJSON-1439847488 tempest-ServersNegativeTestJSON-1439847488-project-member] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-36fd28b8-ea65-4f58-9dbe-3583133e4469 req-d0631a5d-86e4-4050-9ac9-78233b185042 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received event network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36fd28b8-ea65-4f58-9dbe-3583133e4469 req-d0631a5d-86e4-4050-9ac9-78233b185042 service nova] Acquiring lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36fd28b8-ea65-4f58-9dbe-3583133e4469 req-d0631a5d-86e4-4050-9ac9-78233b185042 service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-36fd28b8-ea65-4f58-9dbe-3583133e4469 req-d0631a5d-86e4-4050-9ac9-78233b185042 service nova] Lock "d4101470-c263-4a46-a0cd-1abae9b9f0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-36fd28b8-ea65-4f58-9dbe-3583133e4469 req-d0631a5d-86e4-4050-9ac9-78233b185042 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] No waiting events found dispatching network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:23:18 user nova-compute[74534]: WARNING nova.compute.manager [req-36fd28b8-ea65-4f58-9dbe-3583133e4469 req-d0631a5d-86e4-4050-9ac9-78233b185042 service nova] [instance: d4101470-c263-4a46-a0cd-1abae9b9f0bb] Received unexpected event network-vif-plugged-0832c3fe-7b08-4377-a288-a6c58b555f4b for instance with vm_state deleted and task_state None.
Nov 02 12:23:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:30 user nova-compute[74534]: INFO nova.compute.manager [None req-224f3c9f-a78c-475a-b7aa-fe175a6230a9 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Get console output
Nov 02 12:23:30 user nova-compute[74534]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 02 12:23:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:47 user nova-compute[74534]: INFO nova.compute.manager [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Terminating instance
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-a5e45989-0e67-4dc6-9c07-4312a53cdbc7 req-0dadd4e1-9f46-4369-80ea-86f14179b27a service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received event network-vif-unplugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a5e45989-0e67-4dc6-9c07-4312a53cdbc7 req-0dadd4e1-9f46-4369-80ea-86f14179b27a service nova] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a5e45989-0e67-4dc6-9c07-4312a53cdbc7 req-0dadd4e1-9f46-4369-80ea-86f14179b27a service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a5e45989-0e67-4dc6-9c07-4312a53cdbc7 req-0dadd4e1-9f46-4369-80ea-86f14179b27a service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-a5e45989-0e67-4dc6-9c07-4312a53cdbc7 req-0dadd4e1-9f46-4369-80ea-86f14179b27a service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] No waiting events found dispatching network-vif-unplugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-a5e45989-0e67-4dc6-9c07-4312a53cdbc7 req-0dadd4e1-9f46-4369-80ea-86f14179b27a service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received event network-vif-unplugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Instance destroyed successfully.
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'resources' on Instance uuid 724f27de-2b8b-4bed-9509-a7b358a0f12e {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:13:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1517126308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1517126308',id=23,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-0foazjj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:15:30Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=724f27de-2b8b-4bed-9509-a7b358a0f12e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "address": "fa:16:3e:bc:6a:d7", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a98f20-fe", "ovs_interfaceid": "c3a98f20-fe4a-47c5-91b4-70e0654cbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:d7,bridge_name='br-int',has_traffic_filtering=True,id=c3a98f20-fe4a-47c5-91b4-70e0654cbd4e,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a98f20-fe') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG os_vif [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:d7,bridge_name='br-int',has_traffic_filtering=True,id=c3a98f20-fe4a-47c5-91b4-70e0654cbd4e,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a98f20-fe') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a98f20-fe, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebdb3b99-b08c-4008-aab9-66027f01409c) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:23:47 user nova-compute[74534]: INFO os_vif [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:d7,bridge_name='br-int',has_traffic_filtering=True,id=c3a98f20-fe4a-47c5-91b4-70e0654cbd4e,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a98f20-fe')
Nov 02 12:23:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Deleting instance files /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e_del
Nov 02 12:23:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Deletion of /opt/stack/data/nova/instances/724f27de-2b8b-4bed-9509-a7b358a0f12e_del complete
Nov 02 12:23:48 user nova-compute[74534]: INFO nova.compute.manager [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 12:23:48 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:23:48 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:23:48 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:23:49 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Took 1.15 seconds to deallocate network for instance.
Nov 02 12:23:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e1a259c-3d01-45ed-838e-3d61e51303a2 req-8558ba39-ff2f-48d1-8f70-e814b577231b service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received event network-vif-deleted-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b114be6-8fda-4c15-bc0b-d7a29e9974f1 req-198427f3-0a42-4e9d-ba7a-cc7b0a7ae75b service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received event network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b114be6-8fda-4c15-bc0b-d7a29e9974f1 req-198427f3-0a42-4e9d-ba7a-cc7b0a7ae75b service nova] Acquiring lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b114be6-8fda-4c15-bc0b-d7a29e9974f1 req-198427f3-0a42-4e9d-ba7a-cc7b0a7ae75b service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7b114be6-8fda-4c15-bc0b-d7a29e9974f1 req-198427f3-0a42-4e9d-ba7a-cc7b0a7ae75b service nova] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-7b114be6-8fda-4c15-bc0b-d7a29e9974f1 req-198427f3-0a42-4e9d-ba7a-cc7b0a7ae75b service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] No waiting events found dispatching network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:23:49 user nova-compute[74534]: WARNING nova.compute.manager [req-7b114be6-8fda-4c15-bc0b-d7a29e9974f1 req-198427f3-0a42-4e9d-ba7a-cc7b0a7ae75b service nova] [instance: 724f27de-2b8b-4bed-9509-a7b358a0f12e] Received unexpected event network-vif-plugged-c3a98f20-fe4a-47c5-91b4-70e0654cbd4e for instance with vm_state deleted and task_state None.
Nov 02 12:23:49 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:23:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:49 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Deleted allocations for instance 724f27de-2b8b-4bed-9509-a7b358a0f12e
Nov 02 12:23:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3bb95f0c-b5aa-4ec1-989b-bd093287e405 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "724f27de-2b8b-4bed-9509-a7b358a0f12e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:23:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:23:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:24:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:24:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:24:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:24:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:24:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:24:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8050MB free_disk=25.07406234741211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 45b47223-abde-4927-8ad3-1389fed70985 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance b7864c94-0468-459b-9f5e-86e85c28efed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1b445fab-5562-418a-b14a-d25da40f3fc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 59fa8566-78ea-4809-87f5-d94eb9091d55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:24:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:24:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:24:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:24:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:24:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:31 user nova-compute[74534]: INFO nova.compute.manager [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Terminating instance
Nov 02 12:24:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e6a9c86-f8c5-4919-81e0-2841c3bb244d req-19f5335b-b07d-4c74-9252-24546d606c59 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-unplugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e6a9c86-f8c5-4919-81e0-2841c3bb244d req-19f5335b-b07d-4c74-9252-24546d606c59 service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e6a9c86-f8c5-4919-81e0-2841c3bb244d req-19f5335b-b07d-4c74-9252-24546d606c59 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e6a9c86-f8c5-4919-81e0-2841c3bb244d req-19f5335b-b07d-4c74-9252-24546d606c59 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e6a9c86-f8c5-4919-81e0-2841c3bb244d req-19f5335b-b07d-4c74-9252-24546d606c59 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-unplugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e6a9c86-f8c5-4919-81e0-2841c3bb244d req-19f5335b-b07d-4c74-9252-24546d606c59 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-unplugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Instance destroyed successfully.
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'resources' on Instance uuid b7864c94-0468-459b-9f5e-86e85c28efed {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344270638',display_name='tempest-ServerActionsTestOtherA-server-1344270638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344270638',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:19:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-dn1kg9xl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=b7864c94-0468-459b-9f5e-86e85c28efed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "address": "fa:16:3e:21:4c:09", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ce301a6-44", "ovs_interfaceid": "9ce301a6-44ca-4ef0-81ce-3fa446504903", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_vif [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ce301a6-44, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=282d06eb-d56a-4376-bb82-888aa393d566) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:32 user nova-compute[74534]: INFO os_vif [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4c:09,bridge_name='br-int',has_traffic_filtering=True,id=9ce301a6-44ca-4ef0-81ce-3fa446504903,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ce301a6-44')
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndFiYehR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:24:32 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3488fac7-fe48-436f-a60f-772789166f68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:24:32 user nova-compute[74534]: No targets found.
Nov 02 12:24:32 user nova-compute[74534]: iSNS:
Nov 02 12:24:32 user nova-compute[74534]: No targets found.
Nov 02 12:24:32 user nova-compute[74534]: STATIC:
Nov 02 12:24:32 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:24:32 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:24:32 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:24:32 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1
Nov 02 12:24:32 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:24:32 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:24:32 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af
Nov 02 12:24:32 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:24:32 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:24:32 user nova-compute[74534]: FIRMWARE:
Nov 02 12:24:32 user nova-compute[74534]: No targets found.
Nov 02 12:24:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:24:32 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:24:32 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[549e5e71-1106-4f12-8165-625cdbf2e649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b909c82-4c6c-485c-8d57-b5cdfc6e1db0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:24:32 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:24:32 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:24:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:24:32 user nova-compute[74534]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 (non-flash)
Nov 02 12:24:32 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:24:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c7e3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1'): ({'sde'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Removing single pathed devices sde {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4dc877-8db1-4502-b791-e8200072b11d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "59fa8566-78ea-4809-87f5-d94eb9091d55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:32 user nova-compute[74534]: INFO nova.compute.manager [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Terminating instance
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a764f7b-da9f-4d7a-9db7-a3b9cca62bec]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Flushing IO for device /dev/sde {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380257d-07ab-4828-a502-9fe6efb8424f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed53e178-795e-4af7-a5e8-ad6b3f385390]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] SCSI volumes sde have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_830263d3', '/dev/disk/by-id/scsi-1SCST_BIO830263d3-6440a89d87c8c160', '/dev/disk/by-id/scsi-23634343061383964') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747ce33-bd74-401c-a470-dce64ce828ff]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f51dd-5b11-47a1-b5f6-1d554d192bb0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb4852-8359-4049-9d7d-f6acc2da51a2]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260]
Nov 02 12:24:32 user nova-compute[74534]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1, portal: 172.16.0.220,3260] successful.
Nov 02 12:24:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2984cf70-c44e-4474-863c-ea3f87f96db1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4c16ed-f2f1-4909-8750-32478f648f04]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] <== disconnect_volume: return (347ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:24:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Deleting instance files /opt/stack/data/nova/instances/b7864c94-0468-459b-9f5e-86e85c28efed_del
Nov 02 12:24:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Deletion of /opt/stack/data/nova/instances/b7864c94-0468-459b-9f5e-86e85c28efed_del complete
Nov 02 12:24:32 user nova-compute[74534]: INFO nova.compute.manager [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 02 12:24:32 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:24:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Instance destroyed successfully.
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.objects.instance [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lazy-loading 'resources' on Instance uuid 59fa8566-78ea-4809-87f5-d94eb9091d55 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:22:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-519914117',display_name='tempest-VolumesNegativeTest-instance-519914117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-519914117',id=35,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0644a4713b634b68ba79e5beb0d4211b',ramdisk_id='',reservation_id='r-78ap6rqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-845020160',owner_user_name='tempest-VolumesNegativeTest-845020160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:22:51Z,user_data=None,user_id='02e319e817cc49a5af2d18d01ab590b6',uuid=59fa8566-78ea-4809-87f5-d94eb9091d55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Converting VIF {"id": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "address": "fa:16:3e:ca:7d:77", "network": {"id": "ccec35f0-c0e4-4658-8ff5-3d4185a49db3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c3c2302182984b2da11880efdba31eb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5e4b776-32", "ovs_interfaceid": "a5e4b776-323b-4fe0-b784-0c6097b9dd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=a5e4b776-323b-4fe0-b784-0c6097b9dd37,network=Network(ccec35f0-c0e4-4658-8ff5-3d4185a49db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e4b776-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG os_vif [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=a5e4b776-323b-4fe0-b784-0c6097b9dd37,network=Network(ccec35f0-c0e4-4658-8ff5-3d4185a49db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e4b776-32') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5e4b776-32, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e063dba-c6a5-4e6a-9dc3-f523ab87ae52) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:33 user nova-compute[74534]: INFO os_vif [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:7d:77,bridge_name='br-int',has_traffic_filtering=True,id=a5e4b776-323b-4fe0-b784-0c6097b9dd37,network=Network(ccec35f0-c0e4-4658-8ff5-3d4185a49db3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5e4b776-32')
Nov 02 12:24:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Deleting instance files /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55_del
Nov 02 12:24:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Deletion of /opt/stack/data/nova/instances/59fa8566-78ea-4809-87f5-d94eb9091d55_del complete
Nov 02 12:24:33 user nova-compute[74534]: INFO nova.compute.manager [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Acquiring lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Lock "b7864c94-0468-459b-9f5e-86e85c28efed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] No waiting events found dispatching network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:33 user nova-compute[74534]: WARNING nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received unexpected event network-vif-plugged-9ce301a6-44ca-4ef0-81ce-3fa446504903 for instance with vm_state active and task_state deleting.
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received event network-vif-unplugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Acquiring lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] No waiting events found dispatching network-vif-unplugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received event network-vif-unplugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received event network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Acquiring lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] No waiting events found dispatching network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:33 user nova-compute[74534]: WARNING nova.compute.manager [req-9148aace-107c-402f-915e-07d2fbf36567 req-66088e9d-fd68-4f40-949b-655b19ae9512 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received unexpected event network-vif-plugged-a5e4b776-323b-4fe0-b784-0c6097b9dd37 for instance with vm_state active and task_state deleting.
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:24:33 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Took 1.13 seconds to deallocate network for instance.
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:24:33 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Took 0.63 seconds to deallocate network for instance.
Nov 02 12:24:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-1d09b1f3-1318-47cb-a2ff-9cd009ea9e79 req-dfc65f53-5b9f-477f-9397-418919544876 service nova] [instance: 59fa8566-78ea-4809-87f5-d94eb9091d55] Received event network-vif-deleted-a5e4b776-323b-4fe0-b784-0c6097b9dd37 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:34 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:24:34 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:24:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:34 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Deleted allocations for instance 59fa8566-78ea-4809-87f5-d94eb9091d55
Nov 02 12:24:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fba40aa9-183e-44b1-993b-12b00a3daa8c tempest-VolumesNegativeTest-845020160 tempest-VolumesNegativeTest-845020160-project-member] Lock "59fa8566-78ea-4809-87f5-d94eb9091d55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:34 user nova-compute[74534]: INFO nova.compute.manager [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Took 1.11 seconds to detach 1 volumes for instance.
Nov 02 12:24:34 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Deleting volume: 2984cf70-c44e-4474-863c-ea3f87f96db1 {{(pid=74534) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 12:24:34 user nova-compute[74534]: INFO nova.compute.manager [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Unrescuing
Nov 02 12:24:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:24:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:24:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:24:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:35 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Deleted allocations for instance b7864c94-0468-459b-9f5e-86e85c28efed
Nov 02 12:24:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d9cf281a-a7be-4c52-81fc-5471b77015cd tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "b7864c94-0468-459b-9f5e-86e85c28efed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.193s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'flavor' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-6f618bb2-5684-4006-a6c9-a76a96c9cfb7 req-fab4606c-2e6d-45cf-bdb1-3c791bf963a9 service nova] [instance: b7864c94-0468-459b-9f5e-86e85c28efed] Received event network-vif-deleted-9ce301a6-44ca-4ef0-81ce-3fa446504903 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance destroyed successfully.
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "45b47223-abde-4927-8ad3-1389fed70985" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:37 user nova-compute[74534]: INFO nova.compute.manager [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Terminating instance
Nov 02 12:24:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:37 user nova-compute[74534]: WARNING nova.compute.manager [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:24:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:37 user nova-compute[74534]: WARNING nova.compute.manager [req-ffca902a-2fcd-4c1a-85c3-024b79e5582f req-540135cf-fd77-44ab-bfcd-e4f7b4fe0df8 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-4699c35c-e71d-4e32-84c1-d6ab86262a38 req-9bcdc279-816c-40b2-904e-1d719168ac11 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4699c35c-e71d-4e32-84c1-d6ab86262a38 req-9bcdc279-816c-40b2-904e-1d719168ac11 service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4699c35c-e71d-4e32-84c1-d6ab86262a38 req-9bcdc279-816c-40b2-904e-1d719168ac11 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4699c35c-e71d-4e32-84c1-d6ab86262a38 req-9bcdc279-816c-40b2-904e-1d719168ac11 service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-4699c35c-e71d-4e32-84c1-d6ab86262a38 req-9bcdc279-816c-40b2-904e-1d719168ac11 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-4699c35c-e71d-4e32-84c1-d6ab86262a38 req-9bcdc279-816c-40b2-904e-1d719168ac11 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-unplugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:24:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Instance destroyed successfully.
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'resources' on Instance uuid 45b47223-abde-4927-8ad3-1389fed70985 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322581251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322581251',id=14,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:09:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-dg7alpnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:11:48Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=45b47223-abde-4927-8ad3-1389fed70985,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "address": "fa:16:3e:8c:d2:d9", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc3f134-1a", "ovs_interfaceid": "7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_vif [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dc3f134-1a, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3072b1e-f00d-4719-a0b9-cccb857856f9) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:38 user nova-compute[74534]: INFO os_vif [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:d2:d9,bridge_name='br-int',has_traffic_filtering=True,id=7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc3f134-1a')
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeNhFBDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:24:38 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d407a48-2b93-4396-a986-e08c85fde2f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:24:38 user nova-compute[74534]: No targets found.
Nov 02 12:24:38 user nova-compute[74534]: iSNS:
Nov 02 12:24:38 user nova-compute[74534]: No targets found.
Nov 02 12:24:38 user nova-compute[74534]: STATIC:
Nov 02 12:24:38 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6
Nov 02 12:24:38 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:24:38 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:24:38 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af
Nov 02 12:24:38 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:24:38 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:24:38 user nova-compute[74534]: FIRMWARE:
Nov 02 12:24:38 user nova-compute[74534]: No targets found.
Nov 02 12:24:38 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:24:38 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:24:38 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e950f6-6af6-4ea6-905f-142bcd86cf31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[38987736-af02-4384-a2a0-da1125a8d49f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:24:38 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:24:38 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 (non-flash)
Nov 02 12:24:38 user nova-compute[74534]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:24:38 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1807c8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6'): ({'sdd'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Removing single pathed devices sdd {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ba124-2c32-4c25-bb64-f5a7f4b4ddce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b551f-f2ea-4b09-bb8b-0670db474c3e]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Flushing IO for device /dev/sdd {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80083a6-fbf1-4d77-bf4a-6ae0836adbb5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df842b2-885a-4f92-b3fc-14a95fa651f1]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[36675b56-a93e-44ce-a93a-fd6f555330ef]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bfe6dc-899d-431b-92ee-7e49df806849]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260]
Nov 02 12:24:38 user nova-compute[74534]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6, portal: 172.16.0.220,3260] successful.
Nov 02 12:24:38 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b84838-380c-4c07-860b-c1c4229c9dd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf75bac-4ccc-4dae-8f88-461d424cce2b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] <== disconnect_volume: return (366ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:24:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:24:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Deleting instance files /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985_del
Nov 02 12:24:38 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Deletion of /opt/stack/data/nova/instances/45b47223-abde-4927-8ad3-1389fed70985_del complete
Nov 02 12:24:39 user nova-compute[74534]: INFO nova.compute.manager [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 02 12:24:39 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:24:39 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Took 0.65 seconds to deallocate network for instance.
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:39 user nova-compute[74534]: WARNING nova.compute.manager [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:39 user nova-compute[74534]: WARNING nova.compute.manager [req-846b06b2-2f6e-4abb-a65a-a8a79c735980 req-3669befa-4b11-4a31-8bd6-fb43418443dd service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state rescued and task_state unrescuing.
Nov 02 12:24:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-48057ff1-0242-4dcc-acbf-9175c5f70b78 req-8014ec94-1879-4bfa-bb63-02cc375d9ec7 service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-deleted-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a02af201-8684-480f-b42c-f40be699e112 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:24:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-1d2d46ad-7c32-49a3-b203-65ca6781f317 req-4ae71423-59a5-4844-a24d-9cd73792e83a service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:24:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1d2d46ad-7c32-49a3-b203-65ca6781f317 req-4ae71423-59a5-4844-a24d-9cd73792e83a service nova] Acquiring lock "45b47223-abde-4927-8ad3-1389fed70985-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1d2d46ad-7c32-49a3-b203-65ca6781f317 req-4ae71423-59a5-4844-a24d-9cd73792e83a service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-1d2d46ad-7c32-49a3-b203-65ca6781f317 req-4ae71423-59a5-4844-a24d-9cd73792e83a service nova] Lock "45b47223-abde-4927-8ad3-1389fed70985-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:24:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-1d2d46ad-7c32-49a3-b203-65ca6781f317 req-4ae71423-59a5-4844-a24d-9cd73792e83a service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] No waiting events found dispatching network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:24:40 user nova-compute[74534]: WARNING nova.compute.manager [req-1d2d46ad-7c32-49a3-b203-65ca6781f317 req-4ae71423-59a5-4844-a24d-9cd73792e83a service nova] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Received unexpected event network-vif-plugged-7dc3f134-1a90-4d9f-ba1b-1b7eb7bd67c5 for instance with vm_state active and task_state deleting.
Nov 02 12:24:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:24:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:24:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:24:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:24:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:24:59 user nova-compute[74534]: INFO nova.compute.manager [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 45b47223-abde-4927-8ad3-1389fed70985] Took 19.80 seconds to detach 1 volumes for instance.
Nov 02 12:24:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:24:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:24:59 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:24:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:24:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:00 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Deleted allocations for instance 45b47223-abde-4927-8ad3-1389fed70985
Nov 02 12:25:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-fd837c60-b8f0-4953-a4f1-53abdb5ef874 tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "45b47223-abde-4927-8ad3-1389fed70985" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.380s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:25:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:00 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:25:00 user nova-compute[74534]: INFO nova.compute.claims [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Claim successful on node user
Nov 02 12:25:00 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:25:01 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.policy [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b0523e4883b46aa8f1053d0ba0cb5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7814c1b27fae4e9091df5306dc97e87e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:25:01 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Creating image(s)
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "/opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "/opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk 1073741824" returned: 0 in 0.058s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Successfully created port: 4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:25:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Cannot resize image /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Ensure instance console log exists: /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Successfully updated port: 4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquired lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-changed-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.compute.manager [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Refreshing instance network info cache due to event network-changed-4016153a-5ab9-4af6-9981-e767d5be1e70. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] Acquiring lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updating instance_info_cache with network_info: [{"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Releasing lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Instance network_info: |[{"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] Acquired lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.neutron [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Refreshing network info cache for port 4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Start _get_guest_xml network_info=[{"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:25:02 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:25:02 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-724334490',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-724334490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7243344',id=36,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEau1mS/dbAkH89xi6D4e8BsrWPr4s6IstSd08uDXyzCM2Qtr+ZgnugsE0EYj5DR6Cra3volv9/Mly+9Mh752owSX4YgBeJEiHx5UVTW/aSOHMZ5BQNZUFBc+KZ+8AXEfw==',key_name='tempest-keypair-2001970619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7814c1b27fae4e9091df5306dc97e87e',ramdisk_id='',reservation_id='r-vdkurf86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1886398341',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b0523e4883b46aa8f1053d0ba0cb5e0',uuid=dcef1fcb-e131-4fba-ae3a-882d484514e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Converting VIF {"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:64:ea,bridge_name='br-int',has_traffic_filtering=True,id=4016153a-5ab9-4af6-9981-e767d5be1e70,network=Network(30ea9c51-57f4-4df1-84a2-7b7676351121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4016153a-5a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lazy-loading 'pci_devices' on Instance uuid dcef1fcb-e131-4fba-ae3a-882d484514e9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:25:02 user nova-compute[74534]:   <uuid>dcef1fcb-e131-4fba-ae3a-882d484514e9</uuid>
Nov 02 12:25:02 user nova-compute[74534]:   <name>instance-00000024</name>
Nov 02 12:25:02 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:25:02 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:25:02 user nova-compute[74534]:   <metadata>
Nov 02 12:25:02 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:25:02 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:25:02 user nova-compute[74534]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-724334490</nova:name>
Nov 02 12:25:02 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:25:02</nova:creationTime>
Nov 02 12:25:02 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:25:02 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:25:02 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:25:02 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:25:02 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:25:02 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:25:02 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:25:02 user nova-compute[74534]:       <nova:owner>
Nov 02 12:25:02 user nova-compute[74534]:         <nova:user uuid="2b0523e4883b46aa8f1053d0ba0cb5e0">tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member</nova:user>
Nov 02 12:25:02 user nova-compute[74534]:         <nova:project uuid="7814c1b27fae4e9091df5306dc97e87e">tempest-TestServerVolumeAttachScenarioOldVersion-1886398341</nova:project>
Nov 02 12:25:02 user nova-compute[74534]:       </nova:owner>
Nov 02 12:25:02 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:25:02 user nova-compute[74534]:       <nova:ports>
Nov 02 12:25:02 user nova-compute[74534]:         <nova:port uuid="4016153a-5ab9-4af6-9981-e767d5be1e70">
Nov 02 12:25:02 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 12:25:02 user nova-compute[74534]:         </nova:port>
Nov 02 12:25:02 user nova-compute[74534]:       </nova:ports>
Nov 02 12:25:02 user nova-compute[74534]:     </nova:instance>
Nov 02 12:25:02 user nova-compute[74534]:   </metadata>
Nov 02 12:25:02 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:25:02 user nova-compute[74534]:     <system>
Nov 02 12:25:02 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:25:02 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:25:02 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:25:02 user nova-compute[74534]:       <entry name="serial">dcef1fcb-e131-4fba-ae3a-882d484514e9</entry>
Nov 02 12:25:02 user nova-compute[74534]:       <entry name="uuid">dcef1fcb-e131-4fba-ae3a-882d484514e9</entry>
Nov 02 12:25:02 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:25:02 user nova-compute[74534]:     </system>
Nov 02 12:25:02 user nova-compute[74534]:   </sysinfo>
Nov 02 12:25:02 user nova-compute[74534]:   <os>
Nov 02 12:25:02 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:25:02 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:25:02 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:25:02 user nova-compute[74534]:   </os>
Nov 02 12:25:02 user nova-compute[74534]:   <features>
Nov 02 12:25:02 user nova-compute[74534]:     <acpi/>
Nov 02 12:25:02 user nova-compute[74534]:     <apic/>
Nov 02 12:25:02 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:25:02 user nova-compute[74534]:   </features>
Nov 02 12:25:02 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:25:02 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:25:02 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:25:02 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:25:02 user nova-compute[74534]:   </clock>
Nov 02 12:25:02 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:25:02 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:25:02 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:25:02 user nova-compute[74534]:   </cpu>
Nov 02 12:25:02 user nova-compute[74534]:   <devices>
Nov 02 12:25:02 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:25:02 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:25:02 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk"/>
Nov 02 12:25:02 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:25:02 user nova-compute[74534]:     </disk>
Nov 02 12:25:02 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:25:02 user nova-compute[74534]:       <mac address="fa:16:3e:1d:64:ea"/>
Nov 02 12:25:02 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:25:02 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:25:02 user nova-compute[74534]:       <target dev="tap4016153a-5a"/>
Nov 02 12:25:02 user nova-compute[74534]:     </interface>
Nov 02 12:25:02 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:25:02 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/console.log" append="off"/>
Nov 02 12:25:02 user nova-compute[74534]:     </serial>
Nov 02 12:25:02 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:25:02 user nova-compute[74534]:     <video>
Nov 02 12:25:02 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:25:02 user nova-compute[74534]:     </video>
Nov 02 12:25:02 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:25:02 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:25:02 user nova-compute[74534]:     </rng>
Nov 02 12:25:02 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:25:02 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:25:02 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:25:02 user nova-compute[74534]:     </memballoon>
Nov 02 12:25:02 user nova-compute[74534]:   </devices>
Nov 02 12:25:02 user nova-compute[74534]: </domain>
Nov 02 12:25:02 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-724334490',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-724334490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7243344',id=36,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEau1mS/dbAkH89xi6D4e8BsrWPr4s6IstSd08uDXyzCM2Qtr+ZgnugsE0EYj5DR6Cra3volv9/Mly+9Mh752owSX4YgBeJEiHx5UVTW/aSOHMZ5BQNZUFBc+KZ+8AXEfw==',key_name='tempest-keypair-2001970619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7814c1b27fae4e9091df5306dc97e87e',ramdisk_id='',reservation_id='r-vdkurf86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1886398341',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b0523e4883b46aa8f1053d0ba0cb5e0',uuid=dcef1fcb-e131-4fba-ae3a-882d484514e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Converting VIF {"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:64:ea,bridge_name='br-int',has_traffic_filtering=True,id=4016153a-5ab9-4af6-9981-e767d5be1e70,network=Network(30ea9c51-57f4-4df1-84a2-7b7676351121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4016153a-5a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG os_vif [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:64:ea,bridge_name='br-int',has_traffic_filtering=True,id=4016153a-5ab9-4af6-9981-e767d5be1e70,network=Network(30ea9c51-57f4-4df1-84a2-7b7676351121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4016153a-5a') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed87d409-eb30-514e-bb53-924b492f983a', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4016153a-5a, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4016153a-5a, col_values=(('qos', UUID('815fc3f8-1133-4456-a257-4e902d052110')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4016153a-5a, col_values=(('external_ids', {'iface-id': '4016153a-5ab9-4af6-9981-e767d5be1e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:64:ea', 'vm-uuid': 'dcef1fcb-e131-4fba-ae3a-882d484514e9'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:02 user nova-compute[74534]: INFO os_vif [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:64:ea,bridge_name='br-int',has_traffic_filtering=True,id=4016153a-5ab9-4af6-9981-e767d5be1e70,network=Network(30ea9c51-57f4-4df1-84a2-7b7676351121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4016153a-5a')
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:25:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] No VIF found with MAC fa:16:3e:1d:64:ea, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:25:03 user nova-compute[74534]: DEBUG nova.network.neutron [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updated VIF entry in instance network info cache for port 4016153a-5ab9-4af6-9981-e767d5be1e70. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:25:03 user nova-compute[74534]: DEBUG nova.network.neutron [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updating instance_info_cache with network_info: [{"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:25:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6fd9833f-8c78-40dd-86d4-ae25a6a2f6f2 req-685d8bf9-0037-4e37-b8a9-8c28c2861813 service nova] Releasing lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:25:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-8493bde5-a903-4741-b5d1-1ae6455dd519 req-75b2f546-0ade-4d18-ab80-d8e8909be6e4 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8493bde5-a903-4741-b5d1-1ae6455dd519 req-75b2f546-0ade-4d18-ab80-d8e8909be6e4 service nova] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8493bde5-a903-4741-b5d1-1ae6455dd519 req-75b2f546-0ade-4d18-ab80-d8e8909be6e4 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8493bde5-a903-4741-b5d1-1ae6455dd519 req-75b2f546-0ade-4d18-ab80-d8e8909be6e4 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-8493bde5-a903-4741-b5d1-1ae6455dd519 req-75b2f546-0ade-4d18-ab80-d8e8909be6e4 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] No waiting events found dispatching network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:25:04 user nova-compute[74534]: WARNING nova.compute.manager [req-8493bde5-a903-4741-b5d1-1ae6455dd519 req-75b2f546-0ade-4d18-ab80-d8e8909be6e4 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received unexpected event network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 for instance with vm_state building and task_state spawning.
Nov 02 12:25:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-785e9d8f-82d0-4dc2-89ff-fb6680ed98ac req-75294abd-074d-44b7-87bc-c5f2760fa294 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-785e9d8f-82d0-4dc2-89ff-fb6680ed98ac req-75294abd-074d-44b7-87bc-c5f2760fa294 service nova] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-785e9d8f-82d0-4dc2-89ff-fb6680ed98ac req-75294abd-074d-44b7-87bc-c5f2760fa294 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-785e9d8f-82d0-4dc2-89ff-fb6680ed98ac req-75294abd-074d-44b7-87bc-c5f2760fa294 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-785e9d8f-82d0-4dc2-89ff-fb6680ed98ac req-75294abd-074d-44b7-87bc-c5f2760fa294 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] No waiting events found dispatching network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:25:06 user nova-compute[74534]: WARNING nova.compute.manager [req-785e9d8f-82d0-4dc2-89ff-fb6680ed98ac req-75294abd-074d-44b7-87bc-c5f2760fa294 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received unexpected event network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 for instance with vm_state building and task_state spawning.
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:25:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Instance spawned successfully.
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:25:06 user nova-compute[74534]: INFO nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 02 12:25:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:25:06 user nova-compute[74534]: INFO nova.compute.manager [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Took 6.19 seconds to build instance.
Nov 02 12:25:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d4a75559-8967-402f-a86a-0f63efa8cc50 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.288s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:25:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:25:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8164MB free_disk=25.087753295898438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 3390f6a1-9306-42a3-af5a-b26e113c0b08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance d4876f34-2e47-4d28-994d-1c6c0338b850 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1b445fab-5562-418a-b14a-d25da40f3fc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance dcef1fcb-e131-4fba-ae3a-882d484514e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:25:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:20 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:25:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:25:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:28 user nova-compute[74534]: INFO nova.compute.manager [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Terminating instance
Nov 02 12:25:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:25:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-8045bd8b-7965-4d85-b459-76593781a22d req-21d19ace-6c00-475a-9a28-f62213e919a8 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received event network-vif-unplugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8045bd8b-7965-4d85-b459-76593781a22d req-21d19ace-6c00-475a-9a28-f62213e919a8 service nova] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8045bd8b-7965-4d85-b459-76593781a22d req-21d19ace-6c00-475a-9a28-f62213e919a8 service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8045bd8b-7965-4d85-b459-76593781a22d req-21d19ace-6c00-475a-9a28-f62213e919a8 service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-8045bd8b-7965-4d85-b459-76593781a22d req-21d19ace-6c00-475a-9a28-f62213e919a8 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] No waiting events found dispatching network-vif-unplugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-8045bd8b-7965-4d85-b459-76593781a22d req-21d19ace-6c00-475a-9a28-f62213e919a8 service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received event network-vif-unplugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Instance destroyed successfully.
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lazy-loading 'resources' on Instance uuid 3390f6a1-9306-42a3-af5a-b26e113c0b08 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-115111698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-115111698',id=2,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25ccb20fcd184ecebd3707d9d93c8817',ramdisk_id='',reservation_id='r-2y6fsbi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:06:55Z,user_data=None,user_id='caf5cde0e75e444da00c7bcda4bcdd28',uuid=3390f6a1-9306-42a3-af5a-b26e113c0b08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converting VIF {"id": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "address": "fa:16:3e:e9:3d:4f", "network": {"id": "a92e7202-21c6-4e47-a775-724f49597686", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-362341007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ccb20fcd184ecebd3707d9d93c8817", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6b8eb91-9d", "ovs_interfaceid": "f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:3d:4f,bridge_name='br-int',has_traffic_filtering=True,id=f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b8eb91-9d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG os_vif [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:3d:4f,bridge_name='br-int',has_traffic_filtering=True,id=f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b8eb91-9d') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6b8eb91-9d, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b9ece0e-9a12-4f04-833f-1a9ca7fa6b95) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:29 user nova-compute[74534]: INFO os_vif [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:3d:4f,bridge_name='br-int',has_traffic_filtering=True,id=f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c,network=Network(a92e7202-21c6-4e47-a775-724f49597686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6b8eb91-9d')
Nov 02 12:25:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Deleting instance files /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08_del
Nov 02 12:25:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Deletion of /opt/stack/data/nova/instances/3390f6a1-9306-42a3-af5a-b26e113c0b08_del complete
Nov 02 12:25:29 user nova-compute[74534]: INFO nova.compute.manager [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 02 12:25:29 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:25:29 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:25:30 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:25:30 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Took 0.60 seconds to deallocate network for instance.
Nov 02 12:25:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:30 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:25:30 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:25:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:30 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Deleted allocations for instance 3390f6a1-9306-42a3-af5a-b26e113c0b08
Nov 02 12:25:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-029c1f7f-de2d-4da6-9b8d-f74fe2e0a8dd tempest-ServerBootFromVolumeStableRescueTest-1363504210 tempest-ServerBootFromVolumeStableRescueTest-1363504210-project-member] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-b16105d2-e52a-472f-b081-eb77f723f322 req-533fbca6-77e5-4cec-a6c2-096ad64533eb service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received event network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b16105d2-e52a-472f-b081-eb77f723f322 req-533fbca6-77e5-4cec-a6c2-096ad64533eb service nova] Acquiring lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b16105d2-e52a-472f-b081-eb77f723f322 req-533fbca6-77e5-4cec-a6c2-096ad64533eb service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b16105d2-e52a-472f-b081-eb77f723f322 req-533fbca6-77e5-4cec-a6c2-096ad64533eb service nova] Lock "3390f6a1-9306-42a3-af5a-b26e113c0b08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-b16105d2-e52a-472f-b081-eb77f723f322 req-533fbca6-77e5-4cec-a6c2-096ad64533eb service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] No waiting events found dispatching network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:25:31 user nova-compute[74534]: WARNING nova.compute.manager [req-b16105d2-e52a-472f-b081-eb77f723f322 req-533fbca6-77e5-4cec-a6c2-096ad64533eb service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received unexpected event network-vif-plugged-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c for instance with vm_state deleted and task_state None.
Nov 02 12:25:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-b16105d2-e52a-472f-b081-eb77f723f322 req-533fbca6-77e5-4cec-a6c2-096ad64533eb service nova] [instance: 3390f6a1-9306-42a3-af5a-b26e113c0b08] Received event network-vif-deleted-f6b8eb91-9d42-4e88-8c5f-88b7836dbd0c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:33 user nova-compute[74534]: INFO nova.compute.manager [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Terminating instance
Nov 02 12:25:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-4af9b3ce-efdd-4a34-8a25-fafe10901094 req-28aed390-986f-4d67-8063-1d8491fcdf21 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-vif-unplugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4af9b3ce-efdd-4a34-8a25-fafe10901094 req-28aed390-986f-4d67-8063-1d8491fcdf21 service nova] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4af9b3ce-efdd-4a34-8a25-fafe10901094 req-28aed390-986f-4d67-8063-1d8491fcdf21 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4af9b3ce-efdd-4a34-8a25-fafe10901094 req-28aed390-986f-4d67-8063-1d8491fcdf21 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-4af9b3ce-efdd-4a34-8a25-fafe10901094 req-28aed390-986f-4d67-8063-1d8491fcdf21 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] No waiting events found dispatching network-vif-unplugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-4af9b3ce-efdd-4a34-8a25-fafe10901094 req-28aed390-986f-4d67-8063-1d8491fcdf21 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-vif-unplugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Instance destroyed successfully.
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lazy-loading 'resources' on Instance uuid d4876f34-2e47-4d28-994d-1c6c0338b850 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-969770704',display_name='tempest-ServerActionsTestOtherA-server-969770704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-969770704',id=5,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw1o/MlK4ncVUujYyizOuWuH4UVRudtwz5vp8OrxhK5FosQ/v086greZFSOLzSg44JiZyFewggj8MkOaTdBz7d8oW6DixfWbaxt8nwZl+Avzv6lR8S/14zF/AfP5FmrQ==',key_name='tempest-keypair-1772733970',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:05:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f787c9b1e8154b4da75ac5299c888706',ramdisk_id='',reservation_id='r-z1xffsfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-500741581',owner_user_name='tempest-ServerActionsTestOtherA-500741581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:05:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec72fd62d437457ba42756f1da97516c',uuid=d4876f34-2e47-4d28-994d-1c6c0338b850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converting VIF {"id": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "address": "fa:16:3e:9e:3d:5a", "network": {"id": "f8a18a70-6166-440e-b296-4a46b62e0ecc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2115201477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f787c9b1e8154b4da75ac5299c888706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff8901-03", "ovs_interfaceid": "eeff8901-03cf-47f3-b6ef-27d1abc1479a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3d:5a,bridge_name='br-int',has_traffic_filtering=True,id=eeff8901-03cf-47f3-b6ef-27d1abc1479a,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff8901-03') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG os_vif [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3d:5a,bridge_name='br-int',has_traffic_filtering=True,id=eeff8901-03cf-47f3-b6ef-27d1abc1479a,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff8901-03') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeff8901-03, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f279ae84-00ca-4f2c-a28b-f01926977e5f) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:34 user nova-compute[74534]: INFO os_vif [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3d:5a,bridge_name='br-int',has_traffic_filtering=True,id=eeff8901-03cf-47f3-b6ef-27d1abc1479a,network=Network(f8a18a70-6166-440e-b296-4a46b62e0ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff8901-03')
Nov 02 12:25:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Deleting instance files /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850_del
Nov 02 12:25:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Deletion of /opt/stack/data/nova/instances/d4876f34-2e47-4d28-994d-1c6c0338b850_del complete
Nov 02 12:25:34 user nova-compute[74534]: INFO nova.compute.manager [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 02 12:25:34 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:25:34 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:25:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:35 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:25:35 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Took 0.57 seconds to deallocate network for instance.
Nov 02 12:25:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-4d14f087-a1de-4f78-b28a-8f4ba1cdf9ff req-fbac1299-434a-4683-8115-93b985c8cb0d service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-vif-deleted-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:35 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:25:35 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:25:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:35 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Deleted allocations for instance d4876f34-2e47-4d28-994d-1c6c0338b850
Nov 02 12:25:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0298d104-3a92-4873-ba09-26b517e804d8 tempest-ServerActionsTestOtherA-500741581 tempest-ServerActionsTestOtherA-500741581-project-member] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-bd86daf4-2817-49cb-813e-bfc9232acad1 req-93753606-e7ca-4f2d-a29c-533f543028d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received event network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:25:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd86daf4-2817-49cb-813e-bfc9232acad1 req-93753606-e7ca-4f2d-a29c-533f543028d8 service nova] Acquiring lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:25:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd86daf4-2817-49cb-813e-bfc9232acad1 req-93753606-e7ca-4f2d-a29c-533f543028d8 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:25:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd86daf4-2817-49cb-813e-bfc9232acad1 req-93753606-e7ca-4f2d-a29c-533f543028d8 service nova] Lock "d4876f34-2e47-4d28-994d-1c6c0338b850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:25:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-bd86daf4-2817-49cb-813e-bfc9232acad1 req-93753606-e7ca-4f2d-a29c-533f543028d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] No waiting events found dispatching network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:25:36 user nova-compute[74534]: WARNING nova.compute.manager [req-bd86daf4-2817-49cb-813e-bfc9232acad1 req-93753606-e7ca-4f2d-a29c-533f543028d8 service nova] [instance: d4876f34-2e47-4d28-994d-1c6c0338b850] Received unexpected event network-vif-plugged-eeff8901-03cf-47f3-b6ef-27d1abc1479a for instance with vm_state deleted and task_state None.
Nov 02 12:25:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:25:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:25:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:25:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:25:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:25:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:25:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:26:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:10 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:11 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:26:12 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8422MB free_disk=25.200820922851562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1b445fab-5562-418a-b14a-d25da40f3fc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance dcef1fcb-e131-4fba-ae3a-882d484514e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:26:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:26:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 4 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:26:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Deletion of /opt/stack/data/nova/instances/603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76_resize failed
Nov 02 12:26:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing instance network info cache due to event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG nova.network.neutron [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:27 user nova-compute[74534]: INFO nova.compute.manager [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Detaching volume 60d8aca4-7b65-4616-8a41-497abe0778af
Nov 02 12:26:27 user nova-compute[74534]: INFO nova.virt.block_device [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Attempting to driver detach volume 60d8aca4-7b65-4616-8a41-497abe0778af from mountpoint /dev/vdb
Nov 02 12:26:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Attempting to detach device vdb from instance 1b445fab-5562-418a-b14a-d25da40f3fc1 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:26:27 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:26:27 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:26:27 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:26:27 user nova-compute[74534]:   <serial>60d8aca4-7b65-4616-8a41-497abe0778af</serial>
Nov 02 12:26:27 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:26:27 user nova-compute[74534]: </disk>
Nov 02 12:26:27 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:26:27 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully detached device vdb from instance 1b445fab-5562-418a-b14a-d25da40f3fc1 from the persistent domain config.
Nov 02 12:26:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1b445fab-5562-418a-b14a-d25da40f3fc1 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:26:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:26:27 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:26:27 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:26:27 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:26:27 user nova-compute[74534]:   <serial>60d8aca4-7b65-4616-8a41-497abe0778af</serial>
Nov 02 12:26:27 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:26:27 user nova-compute[74534]: </disk>
Nov 02 12:26:27 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:26:28 user nova-compute[74534]: DEBUG nova.network.neutron [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updated VIF entry in instance network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:26:28 user nova-compute[74534]: DEBUG nova.network.neutron [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cc3c8d00-09f1-477a-851a-47fc0e86f022 req-9b87cd9b-90eb-4118-a3c9-1c02d6821a43 service nova] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:26:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing instance network info cache due to event network-changed-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] Acquiring lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] Acquired lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG nova.network.neutron [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Refreshing network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG nova.network.neutron [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updated VIF entry in instance network info cache for port 89e9cb38-0ab9-44e6-8ec3-5afabcd4c169. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG nova.network.neutron [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [{"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f9ce9f31-9b89-4a06-bba8-9a28f14a8848 req-36085224-b8e6-415d-9b36-9591ed78a5a4 service nova] Releasing lock "refresh_cache-1b445fab-5562-418a-b14a-d25da40f3fc1" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:26:41 user nova-compute[74534]: INFO nova.compute.claims [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Claim successful on node user
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:26:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.policy [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cc8a90d5468473dae411475ada29ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f367e2b6b094dbcb26fe289d0eda148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:26:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Creating image(s)
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.242s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk 1073741824" returned: 0 in 0.055s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Successfully created port: 937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Cannot resize image /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Successfully updated port: 937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquired lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.compute.manager [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing instance network info cache due to event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] Acquiring lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Releasing lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance network_info: |[{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] Acquired lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.neutron [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Start _get_guest_xml network_info=[{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:26:43 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:26:43 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937524847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937524847',id=37,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPauEnbWfweb39Oo3xElef2YuDO9/Kav0uzfxMrQdf82nJM1FT1iXEOfKOiw9e/NOEvFkufTPaB4tsNEI+nZ4LzOpYNQiL3p/zoN3vxpUFMG1duq1lEVySHuV+ffwaneTA==',key_name='tempest-keypair-2048841498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-xrnsj7em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=f2b3c95b-d7a3-4be3-b8b5-19b46846cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.objects.instance [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:26:43 user nova-compute[74534]:   <uuid>f2b3c95b-d7a3-4be3-b8b5-19b46846cb80</uuid>
Nov 02 12:26:43 user nova-compute[74534]:   <name>instance-00000025</name>
Nov 02 12:26:43 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:26:43 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:26:43 user nova-compute[74534]:   <metadata>
Nov 02 12:26:43 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:26:43 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:26:43 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1937524847</nova:name>
Nov 02 12:26:43 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:26:43</nova:creationTime>
Nov 02 12:26:43 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:26:43 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:26:43 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:26:43 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:26:43 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:26:43 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:26:43 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:26:43 user nova-compute[74534]:       <nova:owner>
Nov 02 12:26:43 user nova-compute[74534]:         <nova:user uuid="6cc8a90d5468473dae411475ada29ba6">tempest-AttachVolumeShelveTestJSON-616827552-project-member</nova:user>
Nov 02 12:26:43 user nova-compute[74534]:         <nova:project uuid="2f367e2b6b094dbcb26fe289d0eda148">tempest-AttachVolumeShelveTestJSON-616827552</nova:project>
Nov 02 12:26:43 user nova-compute[74534]:       </nova:owner>
Nov 02 12:26:43 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:26:43 user nova-compute[74534]:       <nova:ports>
Nov 02 12:26:43 user nova-compute[74534]:         <nova:port uuid="937f85a3-c324-4e8a-a72c-a81b10a9e8d3">
Nov 02 12:26:43 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 12:26:43 user nova-compute[74534]:         </nova:port>
Nov 02 12:26:43 user nova-compute[74534]:       </nova:ports>
Nov 02 12:26:43 user nova-compute[74534]:     </nova:instance>
Nov 02 12:26:43 user nova-compute[74534]:   </metadata>
Nov 02 12:26:43 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:26:43 user nova-compute[74534]:     <system>
Nov 02 12:26:43 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:26:43 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:26:43 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:26:43 user nova-compute[74534]:       <entry name="serial">f2b3c95b-d7a3-4be3-b8b5-19b46846cb80</entry>
Nov 02 12:26:43 user nova-compute[74534]:       <entry name="uuid">f2b3c95b-d7a3-4be3-b8b5-19b46846cb80</entry>
Nov 02 12:26:43 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:26:43 user nova-compute[74534]:     </system>
Nov 02 12:26:43 user nova-compute[74534]:   </sysinfo>
Nov 02 12:26:43 user nova-compute[74534]:   <os>
Nov 02 12:26:43 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:26:43 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:26:43 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:26:43 user nova-compute[74534]:   </os>
Nov 02 12:26:43 user nova-compute[74534]:   <features>
Nov 02 12:26:43 user nova-compute[74534]:     <acpi/>
Nov 02 12:26:43 user nova-compute[74534]:     <apic/>
Nov 02 12:26:43 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:26:43 user nova-compute[74534]:   </features>
Nov 02 12:26:43 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:26:43 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:26:43 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:26:43 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:26:43 user nova-compute[74534]:   </clock>
Nov 02 12:26:43 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:26:43 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:26:43 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:26:43 user nova-compute[74534]:   </cpu>
Nov 02 12:26:43 user nova-compute[74534]:   <devices>
Nov 02 12:26:43 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:26:43 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:26:43 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk"/>
Nov 02 12:26:43 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:26:43 user nova-compute[74534]:     </disk>
Nov 02 12:26:43 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:26:43 user nova-compute[74534]:       <mac address="fa:16:3e:ed:f2:0d"/>
Nov 02 12:26:43 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:26:43 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:26:43 user nova-compute[74534]:       <target dev="tap937f85a3-c3"/>
Nov 02 12:26:43 user nova-compute[74534]:     </interface>
Nov 02 12:26:43 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:26:43 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/console.log" append="off"/>
Nov 02 12:26:43 user nova-compute[74534]:     </serial>
Nov 02 12:26:43 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:26:43 user nova-compute[74534]:     <video>
Nov 02 12:26:43 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:26:43 user nova-compute[74534]:     </video>
Nov 02 12:26:43 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:26:43 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:26:43 user nova-compute[74534]:     </rng>
Nov 02 12:26:43 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:26:43 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:26:43 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:26:43 user nova-compute[74534]:     </memballoon>
Nov 02 12:26:43 user nova-compute[74534]:   </devices>
Nov 02 12:26:43 user nova-compute[74534]: </domain>
Nov 02 12:26:43 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937524847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937524847',id=37,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPauEnbWfweb39Oo3xElef2YuDO9/Kav0uzfxMrQdf82nJM1FT1iXEOfKOiw9e/NOEvFkufTPaB4tsNEI+nZ4LzOpYNQiL3p/zoN3vxpUFMG1duq1lEVySHuV+ffwaneTA==',key_name='tempest-keypair-2048841498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-xrnsj7em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=f2b3c95b-d7a3-4be3-b8b5-19b46846cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG os_vif [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '858eb16f-e921-5f94-8991-4f3a6dae6ca6', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap937f85a3-c3, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap937f85a3-c3, col_values=(('qos', UUID('15bf571e-2380-4d4b-8f1c-480cb2e8d033')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap937f85a3-c3, col_values=(('external_ids', {'iface-id': '937f85a3-c324-4e8a-a72c-a81b10a9e8d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f2:0d', 'vm-uuid': 'f2b3c95b-d7a3-4be3-b8b5-19b46846cb80'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:43 user nova-compute[74534]: INFO os_vif [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3')
Nov 02 12:26:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:26:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No VIF found with MAC fa:16:3e:ed:f2:0d, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:26:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:44 user nova-compute[74534]: DEBUG nova.network.neutron [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updated VIF entry in instance network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:26:44 user nova-compute[74534]: DEBUG nova.network.neutron [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a9d9a2e3-fee5-452d-95f7-0e1235f3c521 req-9dedf5d0-ec28-40c7-8a48-7309abdba743 service nova] Releasing lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-0fa4d445-e8a1-47ed-83b2-0331c6bcaa0d req-9ca903f0-1f49-47a5-ad76-21563d30679a service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0fa4d445-e8a1-47ed-83b2-0331c6bcaa0d req-9ca903f0-1f49-47a5-ad76-21563d30679a service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0fa4d445-e8a1-47ed-83b2-0331c6bcaa0d req-9ca903f0-1f49-47a5-ad76-21563d30679a service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0fa4d445-e8a1-47ed-83b2-0331c6bcaa0d req-9ca903f0-1f49-47a5-ad76-21563d30679a service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-0fa4d445-e8a1-47ed-83b2-0331c6bcaa0d req-9ca903f0-1f49-47a5-ad76-21563d30679a service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:26:45 user nova-compute[74534]: WARNING nova.compute.manager [req-0fa4d445-e8a1-47ed-83b2-0331c6bcaa0d req-9ca903f0-1f49-47a5-ad76-21563d30679a service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received unexpected event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with vm_state building and task_state spawning.
Nov 02 12:26:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:26:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance spawned successfully.
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-9e147048-9ef6-4ab2-a24b-ded81ae6aafd req-18a70298-0a29-446e-8bd2-b42f43669844 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9e147048-9ef6-4ab2-a24b-ded81ae6aafd req-18a70298-0a29-446e-8bd2-b42f43669844 service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9e147048-9ef6-4ab2-a24b-ded81ae6aafd req-18a70298-0a29-446e-8bd2-b42f43669844 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9e147048-9ef6-4ab2-a24b-ded81ae6aafd req-18a70298-0a29-446e-8bd2-b42f43669844 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-9e147048-9ef6-4ab2-a24b-ded81ae6aafd req-18a70298-0a29-446e-8bd2-b42f43669844 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:26:47 user nova-compute[74534]: WARNING nova.compute.manager [req-9e147048-9ef6-4ab2-a24b-ded81ae6aafd req-18a70298-0a29-446e-8bd2-b42f43669844 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received unexpected event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with vm_state building and task_state spawning.
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:26:47 user nova-compute[74534]: INFO nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 02 12:26:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:26:47 user nova-compute[74534]: INFO nova.compute.manager [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Took 7.07 seconds to build instance.
Nov 02 12:26:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4a5aa71e-64e7-4b8f-8083-3c23fd21f264 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.181s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1b445fab-5562-418a-b14a-d25da40f3fc1 is timed out.
Nov 02 12:26:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully detached device vdb from instance 1b445fab-5562-418a-b14a-d25da40f3fc1 from the live domain config.
Nov 02 12:26:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyWQMhHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:26:48 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b3465-6b19-4588-b88f-28245130a75e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:26:48 user nova-compute[74534]: No targets found.
Nov 02 12:26:48 user nova-compute[74534]: iSNS:
Nov 02 12:26:48 user nova-compute[74534]: No targets found.
Nov 02 12:26:48 user nova-compute[74534]: STATIC:
Nov 02 12:26:48 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af
Nov 02 12:26:48 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:26:48 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:26:48 user nova-compute[74534]: FIRMWARE:
Nov 02 12:26:48 user nova-compute[74534]: No targets found.
Nov 02 12:26:48 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:26:48 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:26:48 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b212b-8103-4a70-8ab6-5840f65c8f5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d31d810-9d5e-4b25-ba23-aa3c17a6f802]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:26:48 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af (non-flash)
Nov 02 12:26:48 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180666290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[da03419d-6b80-43bb-bd19-17e25947ede6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9fe440-0f47-4cab-8be5-96b264014ebc]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff8e1bb-43c5-4975-8a2e-10e7ac76e4cb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[53920f27-6698-4db7-a1ba-267d925a092b]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac4367-6044-48cc-99a8-6ded62c29d53]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01d08b-5282-4d74-a4fc-a797da2c059e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260]
Nov 02 12:26:48 user nova-compute[74534]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af, portal: 172.16.0.220,3260] successful.
Nov 02 12:26:48 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d8aca4-7b65-4616-8a41-497abe0778af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1ccb4-907a-43bd-9797-64320f077394]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] <== disconnect_volume: return (334ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:26:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:49 user nova-compute[74534]: DEBUG nova.objects.instance [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'flavor' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:26:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0a7bf990-c97f-4f2e-910b-1fd5ac0cd542 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.083s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-changed-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Refreshing instance network info cache due to event network-changed-4016153a-5ab9-4af6-9981-e767d5be1e70. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] Acquiring lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] Acquired lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG nova.network.neutron [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Refreshing network info cache for port 4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG nova.network.neutron [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updated VIF entry in instance network info cache for port 4016153a-5ab9-4af6-9981-e767d5be1e70. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG nova.network.neutron [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updating instance_info_cache with network_info: [{"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5de1c7a3-a346-4cfb-9b25-d84f8df0b92a req-81636a04-cf3c-4c39-8252-990500de9f6d service nova] Releasing lock "refresh_cache-dcef1fcb-e131-4fba-ae3a-882d484514e9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:26:53 user nova-compute[74534]: INFO nova.compute.claims [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Claim successful on node user
Nov 02 12:26:53 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:53 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:26:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:26:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG nova.policy [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45f09340dc9451fbed7968edcfbe0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069eff35ce894007921aee633a568ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:26:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Creating image(s)
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "/opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "/opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.230s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.237s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk 1073741824" returned: 0 in 0.053s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.217s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Successfully created port: 25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Cannot resize image /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Ensure instance console log exists: /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Successfully updated port: 25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquired lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-changed-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Refreshing instance network info cache due to event network-changed-25caa6e9-828b-4876-9be1-ab3cc1a643f2. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] Acquiring lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Releasing lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Instance network_info: |[{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] Acquired lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.neutron [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Refreshing network info cache for port 25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Start _get_guest_xml network_info=[{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:26:56 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:26:56 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-144849544',display_name='tempest-TestStampPattern-server-144849544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-144849544',id=38,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyesrse4Qmq0ljOTmJgUTPa80HlhGnznrWykxLsmeImeZmN0A/GNbPvkdqHaACktMD5zWY+kSTDiHn+TnqzzL/Kc+0idjnFHn3YoqoNxZu+ax4JBkG40G4iIxC7qKcBNA==',key_name='tempest-TestStampPattern-920487778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069eff35ce894007921aee633a568ef7',ramdisk_id='',reservation_id='r-a1ok94y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1394267046',owner_user_name='tempest-TestStampPattern-1394267046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:26:54Z,user_data=None,user_id='e45f09340dc9451fbed7968edcfbe0ff',uuid=8f8b285e-6679-47f5-9467-ae6d788ea0f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converting VIF {"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:fc,bridge_name='br-int',has_traffic_filtering=True,id=25caa6e9-828b-4876-9be1-ab3cc1a643f2,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25caa6e9-82') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:26:56 user nova-compute[74534]:   <uuid>8f8b285e-6679-47f5-9467-ae6d788ea0f6</uuid>
Nov 02 12:26:56 user nova-compute[74534]:   <name>instance-00000026</name>
Nov 02 12:26:56 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:26:56 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:26:56 user nova-compute[74534]:   <metadata>
Nov 02 12:26:56 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:26:56 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:26:56 user nova-compute[74534]:       <nova:name>tempest-TestStampPattern-server-144849544</nova:name>
Nov 02 12:26:56 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:26:56</nova:creationTime>
Nov 02 12:26:56 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:26:56 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:26:56 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:26:56 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:26:56 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:26:56 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:26:56 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:26:56 user nova-compute[74534]:       <nova:owner>
Nov 02 12:26:56 user nova-compute[74534]:         <nova:user uuid="e45f09340dc9451fbed7968edcfbe0ff">tempest-TestStampPattern-1394267046-project-member</nova:user>
Nov 02 12:26:56 user nova-compute[74534]:         <nova:project uuid="069eff35ce894007921aee633a568ef7">tempest-TestStampPattern-1394267046</nova:project>
Nov 02 12:26:56 user nova-compute[74534]:       </nova:owner>
Nov 02 12:26:56 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:26:56 user nova-compute[74534]:       <nova:ports>
Nov 02 12:26:56 user nova-compute[74534]:         <nova:port uuid="25caa6e9-828b-4876-9be1-ab3cc1a643f2">
Nov 02 12:26:56 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 12:26:56 user nova-compute[74534]:         </nova:port>
Nov 02 12:26:56 user nova-compute[74534]:       </nova:ports>
Nov 02 12:26:56 user nova-compute[74534]:     </nova:instance>
Nov 02 12:26:56 user nova-compute[74534]:   </metadata>
Nov 02 12:26:56 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:26:56 user nova-compute[74534]:     <system>
Nov 02 12:26:56 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:26:56 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:26:56 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:26:56 user nova-compute[74534]:       <entry name="serial">8f8b285e-6679-47f5-9467-ae6d788ea0f6</entry>
Nov 02 12:26:56 user nova-compute[74534]:       <entry name="uuid">8f8b285e-6679-47f5-9467-ae6d788ea0f6</entry>
Nov 02 12:26:56 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:26:56 user nova-compute[74534]:     </system>
Nov 02 12:26:56 user nova-compute[74534]:   </sysinfo>
Nov 02 12:26:56 user nova-compute[74534]:   <os>
Nov 02 12:26:56 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:26:56 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:26:56 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:26:56 user nova-compute[74534]:   </os>
Nov 02 12:26:56 user nova-compute[74534]:   <features>
Nov 02 12:26:56 user nova-compute[74534]:     <acpi/>
Nov 02 12:26:56 user nova-compute[74534]:     <apic/>
Nov 02 12:26:56 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:26:56 user nova-compute[74534]:   </features>
Nov 02 12:26:56 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:26:56 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:26:56 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:26:56 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:26:56 user nova-compute[74534]:   </clock>
Nov 02 12:26:56 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:26:56 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:26:56 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:26:56 user nova-compute[74534]:   </cpu>
Nov 02 12:26:56 user nova-compute[74534]:   <devices>
Nov 02 12:26:56 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:26:56 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:26:56 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk"/>
Nov 02 12:26:56 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:26:56 user nova-compute[74534]:     </disk>
Nov 02 12:26:56 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:26:56 user nova-compute[74534]:       <mac address="fa:16:3e:39:93:fc"/>
Nov 02 12:26:56 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:26:56 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:26:56 user nova-compute[74534]:       <target dev="tap25caa6e9-82"/>
Nov 02 12:26:56 user nova-compute[74534]:     </interface>
Nov 02 12:26:56 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:26:56 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/console.log" append="off"/>
Nov 02 12:26:56 user nova-compute[74534]:     </serial>
Nov 02 12:26:56 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:26:56 user nova-compute[74534]:     <video>
Nov 02 12:26:56 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:26:56 user nova-compute[74534]:     </video>
Nov 02 12:26:56 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:26:56 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:26:56 user nova-compute[74534]:     </rng>
Nov 02 12:26:56 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:26:56 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:26:56 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:26:56 user nova-compute[74534]:     </memballoon>
Nov 02 12:26:56 user nova-compute[74534]:   </devices>
Nov 02 12:26:56 user nova-compute[74534]: </domain>
Nov 02 12:26:56 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-144849544',display_name='tempest-TestStampPattern-server-144849544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-144849544',id=38,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyesrse4Qmq0ljOTmJgUTPa80HlhGnznrWykxLsmeImeZmN0A/GNbPvkdqHaACktMD5zWY+kSTDiHn+TnqzzL/Kc+0idjnFHn3YoqoNxZu+ax4JBkG40G4iIxC7qKcBNA==',key_name='tempest-TestStampPattern-920487778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069eff35ce894007921aee633a568ef7',ramdisk_id='',reservation_id='r-a1ok94y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1394267046',owner_user_name='tempest-TestStampPattern-1394267046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:26:54Z,user_data=None,user_id='e45f09340dc9451fbed7968edcfbe0ff',uuid=8f8b285e-6679-47f5-9467-ae6d788ea0f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converting VIF {"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:fc,bridge_name='br-int',has_traffic_filtering=True,id=25caa6e9-828b-4876-9be1-ab3cc1a643f2,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25caa6e9-82') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG os_vif [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:fc,bridge_name='br-int',has_traffic_filtering=True,id=25caa6e9-828b-4876-9be1-ab3cc1a643f2,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25caa6e9-82') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a232a588-c41f-57e0-b042-afe8c97d705a', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25caa6e9-82, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25caa6e9-82, col_values=(('qos', UUID('e8a7fb02-d459-407f-bcec-b911d53b1953')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25caa6e9-82, col_values=(('external_ids', {'iface-id': '25caa6e9-828b-4876-9be1-ab3cc1a643f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:93:fc', 'vm-uuid': '8f8b285e-6679-47f5-9467-ae6d788ea0f6'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:56 user nova-compute[74534]: INFO os_vif [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:fc,bridge_name='br-int',has_traffic_filtering=True,id=25caa6e9-828b-4876-9be1-ab3cc1a643f2,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25caa6e9-82')
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No VIF found with MAC fa:16:3e:39:93:fc, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.neutron [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updated VIF entry in instance network info cache for port 25caa6e9-828b-4876-9be1-ab3cc1a643f2. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG nova.network.neutron [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:26:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c1c6f8ee-570d-41a0-ab3b-64e30587d645 req-2557c330-e98e-401e-8345-e75c33118d41 service nova] Releasing lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-37260f3e-f5b5-4719-b88a-ab2fcdd0490f req-ac24791a-b355-4b5f-80bf-67e2223961fa service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-37260f3e-f5b5-4719-b88a-ab2fcdd0490f req-ac24791a-b355-4b5f-80bf-67e2223961fa service nova] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-37260f3e-f5b5-4719-b88a-ab2fcdd0490f req-ac24791a-b355-4b5f-80bf-67e2223961fa service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-37260f3e-f5b5-4719-b88a-ab2fcdd0490f req-ac24791a-b355-4b5f-80bf-67e2223961fa service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-37260f3e-f5b5-4719-b88a-ab2fcdd0490f req-ac24791a-b355-4b5f-80bf-67e2223961fa service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] No waiting events found dispatching network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:26:58 user nova-compute[74534]: WARNING nova.compute.manager [req-37260f3e-f5b5-4719-b88a-ab2fcdd0490f req-ac24791a-b355-4b5f-80bf-67e2223961fa service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received unexpected event network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 for instance with vm_state building and task_state spawning.
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lazy-loading 'flavor' on Instance uuid dcef1fcb-e131-4fba-ae3a-882d484514e9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:26:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:26:58 user nova-compute[74534]: INFO nova.compute.manager [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Attaching volume 8bbdb77c-83f3-4349-9ce4-3008e5ce3742 to /dev/vdb
Nov 02 12:26:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG os_brick.utils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e58cc0-4138-42b5-9f6e-92f6d89bd0c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7133c0c5-cd0a-436e-979a-b24a05aa5939]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[633f0adf-cc6b-4ced-b2df-30a90aa1acef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac851e1-b103-4d0e-82dc-165f27feb914]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:26:59 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:26:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b07cd-6af3-46ff-ae48-16b1aa2e0109]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG os_brick.utils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:26:59 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updating existing volume attachment record: ff3cb1ae-0c87-4644-a655-e8f7a23c6353 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-20570346-1f26-4610-a7c4-4fe5a77ab15f req-b1ab1110-f2ba-4442-b8ed-d1b485cc52c6 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-20570346-1f26-4610-a7c4-4fe5a77ab15f req-b1ab1110-f2ba-4442-b8ed-d1b485cc52c6 service nova] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-20570346-1f26-4610-a7c4-4fe5a77ab15f req-b1ab1110-f2ba-4442-b8ed-d1b485cc52c6 service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-20570346-1f26-4610-a7c4-4fe5a77ab15f req-b1ab1110-f2ba-4442-b8ed-d1b485cc52c6 service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-20570346-1f26-4610-a7c4-4fe5a77ab15f req-b1ab1110-f2ba-4442-b8ed-d1b485cc52c6 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] No waiting events found dispatching network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:27:00 user nova-compute[74534]: WARNING nova.compute.manager [req-20570346-1f26-4610-a7c4-4fe5a77ab15f req-b1ab1110-f2ba-4442-b8ed-d1b485cc52c6 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received unexpected event network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 for instance with vm_state building and task_state spawning.
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:27:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Instance spawned successfully.
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:01 user nova-compute[74534]: INFO nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 02 12:27:01 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:27:01 user nova-compute[74534]: INFO nova.compute.manager [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Took 7.68 seconds to build instance.
Nov 02 12:27:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c64290a5-2e58-4b15-8377-d262f9d20e38 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.819s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:14 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:27:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:27:15 user nova-compute[74534]: INFO nova.compute.claims [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Claim successful on node user
Nov 02 12:27:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:16 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:27:16 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=25.148052215576172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.194s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.145s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:27:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1b445fab-5562-418a-b14a-d25da40f3fc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance dcef1fcb-e131-4fba-ae3a-882d484514e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.policy [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dac1b3b4e45d42839c9a9413baa0fcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1851244b13ac4d26a5ffabc047210b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:27:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Creating image(s)
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "/opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "/opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "fb52ae3f65bc8232d0bce8a9b9607713071e06ef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "fb52ae3f65bc8232d0bce8a9b9607713071e06ef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:27:16 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.008s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG nova.virt.images [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] acb5348a-8967-4a94-a78d-0047e3acbebd was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.part /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.part /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.converted" returned: 0 in 0.377s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Successfully created port: 00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "fb52ae3f65bc8232d0bce8a9b9607713071e06ef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.469s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "fb52ae3f65bc8232d0bce8a9b9607713071e06ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "fb52ae3f65bc8232d0bce8a9b9607713071e06ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Skipping network cache update for instance because it is being deleted. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:27:18 user nova-compute[74534]: INFO nova.compute.manager [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Terminating instance
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json" returned: 0 in 0.220s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef,backing_fmt=raw /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef,backing_fmt=raw /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk 1073741824" returned: 0 in 0.163s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "fb52ae3f65bc8232d0bce8a9b9607713071e06ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Successfully updated port: 00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing instance network info cache due to event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-d887a145-065e-4746-96f4-5c79d8ef8da9 req-c905bd9f-45e1-49c9-b602-4f3739b59058 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d887a145-065e-4746-96f4-5c79d8ef8da9 req-c905bd9f-45e1-49c9-b602-4f3739b59058 service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d887a145-065e-4746-96f4-5c79d8ef8da9 req-c905bd9f-45e1-49c9-b602-4f3739b59058 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d887a145-065e-4746-96f4-5c79d8ef8da9 req-c905bd9f-45e1-49c9-b602-4f3739b59058 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-d887a145-065e-4746-96f4-5c79d8ef8da9 req-c905bd9f-45e1-49c9-b602-4f3739b59058 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-d887a145-065e-4746-96f4-5c79d8ef8da9 req-c905bd9f-45e1-49c9-b602-4f3739b59058 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-unplugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:27:18 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Cannot resize image /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Ensure instance console log exists: /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance network_info: |[{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Start _get_guest_xml network_info=[{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:27:12Z,direct_url=<?>,disk_format='qcow2',id=acb5348a-8967-4a94-a78d-0047e3acbebd,min_disk=0,min_ram=0,name='tempest-scenario-img--2134007107',owner='1851244b13ac4d26a5ffabc047210b4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:27:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'acb5348a-8967-4a94-a78d-0047e3acbebd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:27:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:27:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:27:12Z,direct_url=<?>,disk_format='qcow2',id=acb5348a-8967-4a94-a78d-0047e3acbebd,min_disk=0,min_ram=0,name='tempest-scenario-img--2134007107',owner='1851244b13ac4d26a5ffabc047210b4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:27:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-206304309',display_name='tempest-TestMinimumBasicScenario-server-206304309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-206304309',id=39,image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX+1vJdxfDhEoA+PYRIdI4ZHl4tNejUTJrRclUGhD/BKh07FxLguVTLoFVhqKuZ0rAPm9kdF6Jxb76pP4CEB6hfPDIG+3jkWPsyS38GhuC5KV8u5MSqFMQ49KoKVcgweA==',key_name='tempest-TestMinimumBasicScenario-2038886643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-hfe32l35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:27:16Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1e1b3a51-03ea-431a-b2fe-8227c4180832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:27:19 user nova-compute[74534]:   <uuid>1e1b3a51-03ea-431a-b2fe-8227c4180832</uuid>
Nov 02 12:27:19 user nova-compute[74534]:   <name>instance-00000027</name>
Nov 02 12:27:19 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:27:19 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:27:19 user nova-compute[74534]:   <metadata>
Nov 02 12:27:19 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:27:19 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:27:19 user nova-compute[74534]:       <nova:name>tempest-TestMinimumBasicScenario-server-206304309</nova:name>
Nov 02 12:27:19 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:27:19</nova:creationTime>
Nov 02 12:27:19 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:27:19 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:27:19 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:27:19 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:27:19 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:27:19 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:27:19 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:27:19 user nova-compute[74534]:       <nova:owner>
Nov 02 12:27:19 user nova-compute[74534]:         <nova:user uuid="dac1b3b4e45d42839c9a9413baa0fcec">tempest-TestMinimumBasicScenario-388517270-project-member</nova:user>
Nov 02 12:27:19 user nova-compute[74534]:         <nova:project uuid="1851244b13ac4d26a5ffabc047210b4d">tempest-TestMinimumBasicScenario-388517270</nova:project>
Nov 02 12:27:19 user nova-compute[74534]:       </nova:owner>
Nov 02 12:27:19 user nova-compute[74534]:       <nova:root type="image" uuid="acb5348a-8967-4a94-a78d-0047e3acbebd"/>
Nov 02 12:27:19 user nova-compute[74534]:       <nova:ports>
Nov 02 12:27:19 user nova-compute[74534]:         <nova:port uuid="00ac64e9-c6c7-4f1f-8288-75daf01fca5b">
Nov 02 12:27:19 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:27:19 user nova-compute[74534]:         </nova:port>
Nov 02 12:27:19 user nova-compute[74534]:       </nova:ports>
Nov 02 12:27:19 user nova-compute[74534]:     </nova:instance>
Nov 02 12:27:19 user nova-compute[74534]:   </metadata>
Nov 02 12:27:19 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:27:19 user nova-compute[74534]:     <system>
Nov 02 12:27:19 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:27:19 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:27:19 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:27:19 user nova-compute[74534]:       <entry name="serial">1e1b3a51-03ea-431a-b2fe-8227c4180832</entry>
Nov 02 12:27:19 user nova-compute[74534]:       <entry name="uuid">1e1b3a51-03ea-431a-b2fe-8227c4180832</entry>
Nov 02 12:27:19 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:27:19 user nova-compute[74534]:     </system>
Nov 02 12:27:19 user nova-compute[74534]:   </sysinfo>
Nov 02 12:27:19 user nova-compute[74534]:   <os>
Nov 02 12:27:19 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:27:19 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:27:19 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:27:19 user nova-compute[74534]:   </os>
Nov 02 12:27:19 user nova-compute[74534]:   <features>
Nov 02 12:27:19 user nova-compute[74534]:     <acpi/>
Nov 02 12:27:19 user nova-compute[74534]:     <apic/>
Nov 02 12:27:19 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:27:19 user nova-compute[74534]:   </features>
Nov 02 12:27:19 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:27:19 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:27:19 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:27:19 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:27:19 user nova-compute[74534]:   </clock>
Nov 02 12:27:19 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:27:19 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:27:19 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:27:19 user nova-compute[74534]:   </cpu>
Nov 02 12:27:19 user nova-compute[74534]:   <devices>
Nov 02 12:27:19 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:27:19 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:27:19 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk"/>
Nov 02 12:27:19 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:27:19 user nova-compute[74534]:     </disk>
Nov 02 12:27:19 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:27:19 user nova-compute[74534]:       <mac address="fa:16:3e:06:1e:30"/>
Nov 02 12:27:19 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:27:19 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:27:19 user nova-compute[74534]:       <target dev="tap00ac64e9-c6"/>
Nov 02 12:27:19 user nova-compute[74534]:     </interface>
Nov 02 12:27:19 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:27:19 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/console.log" append="off"/>
Nov 02 12:27:19 user nova-compute[74534]:     </serial>
Nov 02 12:27:19 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:27:19 user nova-compute[74534]:     <video>
Nov 02 12:27:19 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:27:19 user nova-compute[74534]:     </video>
Nov 02 12:27:19 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:27:19 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:27:19 user nova-compute[74534]:     </rng>
Nov 02 12:27:19 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:27:19 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:27:19 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:27:19 user nova-compute[74534]:     </memballoon>
Nov 02 12:27:19 user nova-compute[74534]:   </devices>
Nov 02 12:27:19 user nova-compute[74534]: </domain>
Nov 02 12:27:19 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-206304309',display_name='tempest-TestMinimumBasicScenario-server-206304309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-206304309',id=39,image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX+1vJdxfDhEoA+PYRIdI4ZHl4tNejUTJrRclUGhD/BKh07FxLguVTLoFVhqKuZ0rAPm9kdF6Jxb76pP4CEB6hfPDIG+3jkWPsyS38GhuC5KV8u5MSqFMQ49KoKVcgweA==',key_name='tempest-TestMinimumBasicScenario-2038886643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-hfe32l35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:27:16Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1e1b3a51-03ea-431a-b2fe-8227c4180832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG os_vif [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64229364-445f-52f3-ab38-44e2e436edd0', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Instance destroyed successfully.
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.objects.instance [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'resources' on Instance uuid 1b445fab-5562-418a-b14a-d25da40f3fc1 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00ac64e9-c6, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00ac64e9-c6, col_values=(('qos', UUID('4b860210-148e-4be1-8568-b53c8a668dd6')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00ac64e9-c6, col_values=(('external_ids', {'iface-id': '00ac64e9-c6c7-4f1f-8288-75daf01fca5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:1e:30', 'vm-uuid': '1e1b3a51-03ea-431a-b2fe-8227c4180832'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2096656522',display_name='tempest-ServerRescueNegativeTestJSON-server-2096656522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2096656522',id=34,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwBvnAFBaomGwtXuR0NJ8EhEfw65vBp4jQPxtgOkXGSyhXiIkLJnbT9dVjv6sat647ZUyfRWtGQxP50/jmy14imFFE3MhsD15fHSOQtWHVu73D30wcZ7sqQzS5lGVFZ6w==',key_name='tempest-keypair-1795761394',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:22:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-p0jltjat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=1b445fab-5562-418a-b14a-d25da40f3fc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "address": "fa:16:3e:ac:cf:7b", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e9cb38-0a", "ovs_interfaceid": "89e9cb38-0ab9-44e6-8ec3-5afabcd4c169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG os_vif [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: INFO os_vif [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6')
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89e9cb38-0a, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87cf104d-3abf-4091-bc99-3e390e18cba5) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [{"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:19 user nova-compute[74534]: INFO os_vif [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:7b,bridge_name='br-int',has_traffic_filtering=True,id=89e9cb38-0ab9-44e6-8ec3-5afabcd4c169,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e9cb38-0a')
Nov 02 12:27:19 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Deleting instance files /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1_del
Nov 02 12:27:19 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Deletion of /opt/stack/data/nova/instances/1b445fab-5562-418a-b14a-d25da40f3fc1_del complete
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-90d26a35-e2a4-4f31-bc84-579e2ab28798" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No VIF found with MAC fa:16:3e:06:1e:30, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:27:19 user nova-compute[74534]: INFO nova.compute.manager [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updated VIF entry in instance network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:27:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-43f6c059-135d-4ecc-8d10-bd0f656f4d11 req-4fcff1e9-5bb6-48fa-8b17-048ff1c793a3 service nova] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:27:20 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:27:20 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Took 0.90 seconds to deallocate network for instance.
Nov 02 12:27:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:20 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:27:20 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:27:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-ab4ad2c2-5ec7-4c7a-8e25-11b28c31ca25 req-e93db396-7728-4735-871c-f8ef210006c5 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab4ad2c2-5ec7-4c7a-8e25-11b28c31ca25 req-e93db396-7728-4735-871c-f8ef210006c5 service nova] Acquiring lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab4ad2c2-5ec7-4c7a-8e25-11b28c31ca25 req-e93db396-7728-4735-871c-f8ef210006c5 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ab4ad2c2-5ec7-4c7a-8e25-11b28c31ca25 req-e93db396-7728-4735-871c-f8ef210006c5 service nova] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-ab4ad2c2-5ec7-4c7a-8e25-11b28c31ca25 req-e93db396-7728-4735-871c-f8ef210006c5 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] No waiting events found dispatching network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:27:21 user nova-compute[74534]: WARNING nova.compute.manager [req-ab4ad2c2-5ec7-4c7a-8e25-11b28c31ca25 req-e93db396-7728-4735-871c-f8ef210006c5 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received unexpected event network-vif-plugged-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 for instance with vm_state deleted and task_state None.
Nov 02 12:27:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-ab4ad2c2-5ec7-4c7a-8e25-11b28c31ca25 req-e93db396-7728-4735-871c-f8ef210006c5 service nova] [instance: 1b445fab-5562-418a-b14a-d25da40f3fc1] Received event network-vif-deleted-89e9cb38-0ab9-44e6-8ec3-5afabcd4c169 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:27:21 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Deleted allocations for instance 1b445fab-5562-418a-b14a-d25da40f3fc1
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-f953374f-89ae-445e-b564-0abedd4f162a tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "1b445fab-5562-418a-b14a-d25da40f3fc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.821s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-a4b86ffa-0075-41e0-a635-c40ccede0452 req-22f7e162-67b4-40fa-a1ba-240f1d596852 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a4b86ffa-0075-41e0-a635-c40ccede0452 req-22f7e162-67b4-40fa-a1ba-240f1d596852 service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a4b86ffa-0075-41e0-a635-c40ccede0452 req-22f7e162-67b4-40fa-a1ba-240f1d596852 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a4b86ffa-0075-41e0-a635-c40ccede0452 req-22f7e162-67b4-40fa-a1ba-240f1d596852 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-a4b86ffa-0075-41e0-a635-c40ccede0452 req-22f7e162-67b4-40fa-a1ba-240f1d596852 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:27:21 user nova-compute[74534]: WARNING nova.compute.manager [req-a4b86ffa-0075-41e0-a635-c40ccede0452 req-22f7e162-67b4-40fa-a1ba-240f1d596852 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received unexpected event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with vm_state building and task_state spawning.
Nov 02 12:27:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBLpfRnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:27:21 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:27:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:27:21 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:27:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:27:21 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1cb0a6-5249-4527-86f4-e43b01c9dc69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:27:21 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[90162cd8-23d7-4ff4-8362-bd5f1324321b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742] added
Nov 02 12:27:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc4c03-88e2-44b1-81c8-6ca96b3b5862]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[021a35fd-05db-42d0-a9eb-21d03f741a4f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBLpfRnE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBLpfRnE" returned: 0 in 0.036s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f763b89-22d7-4cac-be54-71e2468c515d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBLpfRnE'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4109d-7bc8-4935-b60a-2772e42291d9]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d97abd6-b5df-4950-80a2-60fc732475f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:27:22 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:27:22 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:27:22 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:27:22 user nova-compute[74534]: 
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10cfb13-cf6e-458d-8f2f-5f115d34cce5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260]
Nov 02 12:27:22 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260] successful.
Nov 02 12:27:22 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[74343563-1a22-4f1d-bba4-576c8e9ff23e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8759182a-3b3a-488a-ba6b-c55a22def793]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 (non-flash)
Nov 02 12:27:22 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 (non-flash)
Nov 02 12:27:22 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[99357af0-2291-401c-80a7-366c735b820b]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:27:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBLpfRnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26562626466343464', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562626466343464', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lazy-loading 'flavor' on Instance uuid dcef1fcb-e131-4fba-ae3a-882d484514e9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:27:23 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:27:23 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:27:23 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:27:23 user nova-compute[74534]:   <serial>8bbdb77c-83f3-4349-9ce4-3008e5ce3742</serial>
Nov 02 12:27:23 user nova-compute[74534]: </disk>
Nov 02 12:27:23 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:27:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance spawned successfully.
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-44a4b28d-e26a-47d5-86c7-41ab5f8ff938 req-95e8d0a0-6b28-4f94-b847-8ff8d583551f service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-44a4b28d-e26a-47d5-86c7-41ab5f8ff938 req-95e8d0a0-6b28-4f94-b847-8ff8d583551f service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-44a4b28d-e26a-47d5-86c7-41ab5f8ff938 req-95e8d0a0-6b28-4f94-b847-8ff8d583551f service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-44a4b28d-e26a-47d5-86c7-41ab5f8ff938 req-95e8d0a0-6b28-4f94-b847-8ff8d583551f service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-44a4b28d-e26a-47d5-86c7-41ab5f8ff938 req-95e8d0a0-6b28-4f94-b847-8ff8d583551f service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:27:23 user nova-compute[74534]: WARNING nova.compute.manager [req-44a4b28d-e26a-47d5-86c7-41ab5f8ff938 req-95e8d0a0-6b28-4f94-b847-8ff8d583551f service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received unexpected event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with vm_state building and task_state spawning.
Nov 02 12:27:23 user nova-compute[74534]: INFO nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 02 12:27:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:27:24 user nova-compute[74534]: INFO nova.compute.manager [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Took 9.02 seconds to build instance.
Nov 02 12:27:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eef8407-9495-46a9-8228-2359cf7bdf9e tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.194s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:27:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:27:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] No VIF found with MAC fa:16:3e:1d:64:ea, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:27:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:27:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1bd79394-dfda-46f7-b07e-505e36a4d030 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.334s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:27:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:27:26 user nova-compute[74534]: INFO nova.compute.manager [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Detaching volume 8bbdb77c-83f3-4349-9ce4-3008e5ce3742
Nov 02 12:27:26 user nova-compute[74534]: INFO nova.virt.block_device [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Attempting to driver detach volume 8bbdb77c-83f3-4349-9ce4-3008e5ce3742 from mountpoint /dev/vdb
Nov 02 12:27:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Attempting to detach device vdb from instance dcef1fcb-e131-4fba-ae3a-882d484514e9 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:27:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:27:26 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:27:26 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:27:26 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:27:26 user nova-compute[74534]:   <serial>8bbdb77c-83f3-4349-9ce4-3008e5ce3742</serial>
Nov 02 12:27:26 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:27:26 user nova-compute[74534]: </disk>
Nov 02 12:27:26 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:27:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Successfully detached device vdb from instance dcef1fcb-e131-4fba-ae3a-882d484514e9 from the persistent domain config.
Nov 02 12:27:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcef1fcb-e131-4fba-ae3a-882d484514e9 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:27:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:27:26 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:27:26 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:27:26 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:27:26 user nova-compute[74534]:   <serial>8bbdb77c-83f3-4349-9ce4-3008e5ce3742</serial>
Nov 02 12:27:26 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:27:26 user nova-compute[74534]: </disk>
Nov 02 12:27:26 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:27:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcef1fcb-e131-4fba-ae3a-882d484514e9 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:27:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:47 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dcef1fcb-e131-4fba-ae3a-882d484514e9 is timed out.
Nov 02 12:27:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Successfully detached device vdb from instance dcef1fcb-e131-4fba-ae3a-882d484514e9 from the live domain config.
Nov 02 12:27:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBLpfRnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:27:47 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c71cf2-2228-49e2-b739-e45e56edaea1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:27:47 user nova-compute[74534]: No targets found.
Nov 02 12:27:47 user nova-compute[74534]: iSNS:
Nov 02 12:27:47 user nova-compute[74534]: No targets found.
Nov 02 12:27:47 user nova-compute[74534]: STATIC:
Nov 02 12:27:47 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742
Nov 02 12:27:47 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:27:47 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:27:47 user nova-compute[74534]: FIRMWARE:
Nov 02 12:27:47 user nova-compute[74534]: No targets found.
Nov 02 12:27:47 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:27:47 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:27:47 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d50ba-73db-4b34-8b57-fcd0bd16c0d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d53d5be-c8f3-4230-aaa3-505f565371f3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 (non-flash)
Nov 02 12:27:47 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 (non-flash)
Nov 02 12:27:47 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c4b9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2763f34-78e4-4eb0-b173-fac4d7b89f08]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b949b5-34e1-4583-9f1c-32d3f12e3728]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a42471-b8aa-44af-9c01-21172fb3b014]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2325434-d68c-4391-a64f-015e81d649d7]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20fd518-7381-4270-b8aa-66fc43ecaebd]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be4b873-295d-4927-9ad7-3b59683b8130]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260]
Nov 02 12:27:47 user nova-compute[74534]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742, portal: 172.16.0.220,3260] successful.
Nov 02 12:27:47 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbdb77c-83f3-4349-9ce4-3008e5ce3742 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca7bf9f-45c6-4003-b41f-680bca2711e5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] <== disconnect_volume: return (303ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:27:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:27:48 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lazy-loading 'flavor' on Instance uuid dcef1fcb-e131-4fba-ae3a-882d484514e9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:27:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a1779235-5530-4734-9da8-b0690d7a6cb5 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.853s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:27:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:27:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:28:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=25.055755615234375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance dcef1fcb-e131-4fba-ae3a-882d484514e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:28:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:28:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:28:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:28:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:28:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [{"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:28:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:28:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:20 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:28:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing instance network info cache due to event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:28:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] Acquiring lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:28:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] Acquired lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:28:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:32 user nova-compute[74534]: INFO nova.compute.manager [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Terminating instance
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.network.neutron [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updated VIF entry in instance network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.network.neutron [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-033f9f0c-a0e5-47d2-926d-5874bafdf5a3 req-02bd848c-d6a7-411f-8c6d-2897cae33ddb service nova] Releasing lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-13438f7b-bdee-4ecb-b61e-e807062fad83 req-4afb4976-7cf8-45ed-b1b0-229aa9c8e0b2 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-vif-unplugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-13438f7b-bdee-4ecb-b61e-e807062fad83 req-4afb4976-7cf8-45ed-b1b0-229aa9c8e0b2 service nova] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-13438f7b-bdee-4ecb-b61e-e807062fad83 req-4afb4976-7cf8-45ed-b1b0-229aa9c8e0b2 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-13438f7b-bdee-4ecb-b61e-e807062fad83 req-4afb4976-7cf8-45ed-b1b0-229aa9c8e0b2 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-13438f7b-bdee-4ecb-b61e-e807062fad83 req-4afb4976-7cf8-45ed-b1b0-229aa9c8e0b2 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] No waiting events found dispatching network-vif-unplugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-13438f7b-bdee-4ecb-b61e-e807062fad83 req-4afb4976-7cf8-45ed-b1b0-229aa9c8e0b2 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-vif-unplugged-4016153a-5ab9-4af6-9981-e767d5be1e70 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:28:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Instance destroyed successfully.
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lazy-loading 'resources' on Instance uuid dcef1fcb-e131-4fba-ae3a-882d484514e9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-724334490',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-724334490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7243344',id=36,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEau1mS/dbAkH89xi6D4e8BsrWPr4s6IstSd08uDXyzCM2Qtr+ZgnugsE0EYj5DR6Cra3volv9/Mly+9Mh752owSX4YgBeJEiHx5UVTW/aSOHMZ5BQNZUFBc+KZ+8AXEfw==',key_name='tempest-keypair-2001970619',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:25:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7814c1b27fae4e9091df5306dc97e87e',ramdisk_id='',reservation_id='r-vdkurf86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1886398341',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b0523e4883b46aa8f1053d0ba0cb5e0',uuid=dcef1fcb-e131-4fba-ae3a-882d484514e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Converting VIF {"id": "4016153a-5ab9-4af6-9981-e767d5be1e70", "address": "fa:16:3e:1d:64:ea", "network": {"id": "30ea9c51-57f4-4df1-84a2-7b7676351121", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-645016123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7814c1b27fae4e9091df5306dc97e87e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4016153a-5a", "ovs_interfaceid": "4016153a-5ab9-4af6-9981-e767d5be1e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:64:ea,bridge_name='br-int',has_traffic_filtering=True,id=4016153a-5ab9-4af6-9981-e767d5be1e70,network=Network(30ea9c51-57f4-4df1-84a2-7b7676351121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4016153a-5a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG os_vif [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:64:ea,bridge_name='br-int',has_traffic_filtering=True,id=4016153a-5ab9-4af6-9981-e767d5be1e70,network=Network(30ea9c51-57f4-4df1-84a2-7b7676351121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4016153a-5a') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4016153a-5a, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=815fc3f8-1133-4456-a257-4e902d052110) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:32 user nova-compute[74534]: INFO os_vif [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:64:ea,bridge_name='br-int',has_traffic_filtering=True,id=4016153a-5ab9-4af6-9981-e767d5be1e70,network=Network(30ea9c51-57f4-4df1-84a2-7b7676351121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4016153a-5a')
Nov 02 12:28:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Deleting instance files /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9_del
Nov 02 12:28:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Deletion of /opt/stack/data/nova/instances/dcef1fcb-e131-4fba-ae3a-882d484514e9_del complete
Nov 02 12:28:32 user nova-compute[74534]: INFO nova.compute.manager [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 12:28:32 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:28:32 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:28:33 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:33 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Took 0.89 seconds to deallocate network for instance.
Nov 02 12:28:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-91851114-abb8-474c-a660-dc1f8b98c19e req-ff909cac-64d8-4774-aab2-fc85c10cbf25 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-vif-deleted-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:33 user nova-compute[74534]: INFO nova.compute.manager [req-91851114-abb8-474c-a660-dc1f8b98c19e req-ff909cac-64d8-4774-aab2-fc85c10cbf25 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Neutron deleted interface 4016153a-5ab9-4af6-9981-e767d5be1e70; detaching it from the instance and deleting it from the info cache
Nov 02 12:28:33 user nova-compute[74534]: DEBUG nova.network.neutron [req-91851114-abb8-474c-a660-dc1f8b98c19e req-ff909cac-64d8-4774-aab2-fc85c10cbf25 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-91851114-abb8-474c-a660-dc1f8b98c19e req-ff909cac-64d8-4774-aab2-fc85c10cbf25 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Detach interface failed, port_id=4016153a-5ab9-4af6-9981-e767d5be1e70, reason: Instance dcef1fcb-e131-4fba-ae3a-882d484514e9 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:28:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:34 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Deleted allocations for instance dcef1fcb-e131-4fba-ae3a-882d484514e9
Nov 02 12:28:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3ce549e3-875a-4894-bd84-719175ce1409 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341 tempest-TestServerVolumeAttachScenarioOldVersion-1886398341-project-member] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.243s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-e945366e-3038-4325-819d-f97bb924d984 req-111ea4d6-5b4e-423b-9e28-d099e54ff317 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received event network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e945366e-3038-4325-819d-f97bb924d984 req-111ea4d6-5b4e-423b-9e28-d099e54ff317 service nova] Acquiring lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e945366e-3038-4325-819d-f97bb924d984 req-111ea4d6-5b4e-423b-9e28-d099e54ff317 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e945366e-3038-4325-819d-f97bb924d984 req-111ea4d6-5b4e-423b-9e28-d099e54ff317 service nova] Lock "dcef1fcb-e131-4fba-ae3a-882d484514e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-e945366e-3038-4325-819d-f97bb924d984 req-111ea4d6-5b4e-423b-9e28-d099e54ff317 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] No waiting events found dispatching network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:28:34 user nova-compute[74534]: WARNING nova.compute.manager [req-e945366e-3038-4325-819d-f97bb924d984 req-111ea4d6-5b4e-423b-9e28-d099e54ff317 service nova] [instance: dcef1fcb-e131-4fba-ae3a-882d484514e9] Received unexpected event network-vif-plugged-4016153a-5ab9-4af6-9981-e767d5be1e70 for instance with vm_state deleted and task_state None.
Nov 02 12:28:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:36 user nova-compute[74534]: INFO nova.compute.manager [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Terminating instance
Nov 02 12:28:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:28:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-ce69d346-8bdc-40ec-a404-c51281415dfc req-44cb7595-2861-49d5-aae4-a2220ae1b786 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-unplugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ce69d346-8bdc-40ec-a404-c51281415dfc req-44cb7595-2861-49d5-aae4-a2220ae1b786 service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ce69d346-8bdc-40ec-a404-c51281415dfc req-44cb7595-2861-49d5-aae4-a2220ae1b786 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ce69d346-8bdc-40ec-a404-c51281415dfc req-44cb7595-2861-49d5-aae4-a2220ae1b786 service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-ce69d346-8bdc-40ec-a404-c51281415dfc req-44cb7595-2861-49d5-aae4-a2220ae1b786 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-unplugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-ce69d346-8bdc-40ec-a404-c51281415dfc req-44cb7595-2861-49d5-aae4-a2220ae1b786 service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-unplugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Instance destroyed successfully.
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.objects.instance [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'resources' on Instance uuid 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1669898121',display_name='tempest-ServerRescueNegativeTestJSON-server-1669898121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1669898121',id=21,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-kbh3bbls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:13:44Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=57ce1c49-200f-4b56-a1b7-78aeec6fc3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "address": "fa:16:3e:75:4f:99", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bef23e-68", "ovs_interfaceid": "d9bef23e-680a-470e-b4dd-8162d69fa4df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG os_vif [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9bef23e-68, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ef22620-1783-4e1f-8859-a4169174c210) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:37 user nova-compute[74534]: INFO os_vif [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4f:99,bridge_name='br-int',has_traffic_filtering=True,id=d9bef23e-680a-470e-b4dd-8162d69fa4df,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bef23e-68')
Nov 02 12:28:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Deleting instance files /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac_del
Nov 02 12:28:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Deletion of /opt/stack/data/nova/instances/57ce1c49-200f-4b56-a1b7-78aeec6fc3ac_del complete
Nov 02 12:28:37 user nova-compute[74534]: INFO nova.compute.manager [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 02 12:28:37 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:28:37 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:28:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-e7aa16c1-efbc-407f-87fa-6db5a8220c4f req-c376944d-7da0-4a52-b25a-e9ec881e154b service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-deleted-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:38 user nova-compute[74534]: INFO nova.compute.manager [req-e7aa16c1-efbc-407f-87fa-6db5a8220c4f req-c376944d-7da0-4a52-b25a-e9ec881e154b service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Neutron deleted interface d9bef23e-680a-470e-b4dd-8162d69fa4df; detaching it from the instance and deleting it from the info cache
Nov 02 12:28:38 user nova-compute[74534]: DEBUG nova.network.neutron [req-e7aa16c1-efbc-407f-87fa-6db5a8220c4f req-c376944d-7da0-4a52-b25a-e9ec881e154b service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:38 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:38 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Took 1.05 seconds to deallocate network for instance.
Nov 02 12:28:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-e7aa16c1-efbc-407f-87fa-6db5a8220c4f req-c376944d-7da0-4a52-b25a-e9ec881e154b service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Detach interface failed, port_id=d9bef23e-680a-470e-b4dd-8162d69fa4df, reason: Instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:28:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:38 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:28:38 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:28:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:38 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Deleted allocations for instance 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac
Nov 02 12:28:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-2ff5e982-ccc9-4ebf-a343-3055e55fb393 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-00731f24-9ba7-4141-8da9-8bfcb50acea9 req-5cc5790d-a270-40c8-9950-dea25753dbdf service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-00731f24-9ba7-4141-8da9-8bfcb50acea9 req-5cc5790d-a270-40c8-9950-dea25753dbdf service nova] Acquiring lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-00731f24-9ba7-4141-8da9-8bfcb50acea9 req-5cc5790d-a270-40c8-9950-dea25753dbdf service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-00731f24-9ba7-4141-8da9-8bfcb50acea9 req-5cc5790d-a270-40c8-9950-dea25753dbdf service nova] Lock "57ce1c49-200f-4b56-a1b7-78aeec6fc3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG nova.compute.manager [req-00731f24-9ba7-4141-8da9-8bfcb50acea9 req-5cc5790d-a270-40c8-9950-dea25753dbdf service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] No waiting events found dispatching network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:28:39 user nova-compute[74534]: WARNING nova.compute.manager [req-00731f24-9ba7-4141-8da9-8bfcb50acea9 req-5cc5790d-a270-40c8-9950-dea25753dbdf service nova] [instance: 57ce1c49-200f-4b56-a1b7-78aeec6fc3ac] Received unexpected event network-vif-plugged-d9bef23e-680a-470e-b4dd-8162d69fa4df for instance with vm_state deleted and task_state None.
Nov 02 12:28:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:39 user nova-compute[74534]: INFO nova.compute.manager [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Shelving
Nov 02 12:28:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:40 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance destroyed successfully.
Nov 02 12:28:40 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Beginning cold snapshot process
Nov 02 12:28:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-unplugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-unplugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:28:40 user nova-compute[74534]: WARNING nova.compute.manager [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received unexpected event network-vif-unplugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with vm_state active and task_state shelving.
Nov 02 12:28:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:28:40 user nova-compute[74534]: WARNING nova.compute.manager [req-4f53fcaa-385c-464b-bb09-61b783abba2b req-690894b6-0b6c-4a20-aead-d34b0f417d65 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received unexpected event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with vm_state active and task_state shelving.
Nov 02 12:28:40 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:28:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk /opt/stack/data/nova/instances/snapshots/tmpjpktgdy1/8add8f69a1164fb6abf113c539948089 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk /opt/stack/data/nova/instances/snapshots/tmpjpktgdy1/8add8f69a1164fb6abf113c539948089" returned: 0 in 0.680s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:41 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Snapshot extracted, beginning image upload
Nov 02 12:28:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Snapshot image upload complete
Nov 02 12:28:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:28:43 user nova-compute[74534]: INFO nova.compute.manager [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Shelve offloading
Nov 02 12:28:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance destroyed successfully.
Nov 02 12:28:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:28:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:28:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquired lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:28:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:28:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Releasing lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:28:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance destroyed successfully.
Nov 02 12:28:45 user nova-compute[74534]: DEBUG nova.objects.instance [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'resources' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937524847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937524847',id=37,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPauEnbWfweb39Oo3xElef2YuDO9/Kav0uzfxMrQdf82nJM1FT1iXEOfKOiw9e/NOEvFkufTPaB4tsNEI+nZ4LzOpYNQiL3p/zoN3vxpUFMG1duq1lEVySHuV+ffwaneTA==',key_name='tempest-keypair-2048841498',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-xrnsj7em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member',shelved_at='2023-11-02T12:28:43.812493',shelved_host='user',shelved_image_id='e184a092-5ee6-47ff-b774-707caa96e880'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=f2b3c95b-d7a3-4be3-b8b5-19b46846cb80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG os_vif [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap937f85a3-c3, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15bf571e-2380-4d4b-8f1c-480cb2e8d033) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:45 user nova-compute[74534]: INFO os_vif [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3')
Nov 02 12:28:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Deleting instance files /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80_del
Nov 02 12:28:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Deletion of /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80_del complete
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing instance network info cache due to event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] Acquiring lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] Acquired lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.network.neutron [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:28:46 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Deleted allocations for instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80
Nov 02 12:28:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.objects.instance [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'numa_topology' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.objects.base [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<f2b3c95b-d7a3-4be3-b8b5-19b46846cb80> lazy-loaded attributes: resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-26297215-3c74-438d-8ae5-054e102f7d95 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.746s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.network.neutron [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updated VIF entry in instance network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG nova.network.neutron [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap937f85a3-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-04ae3c8c-1b24-497e-96a6-f5e57e369d68 req-ebc60301-530c-4128-a6de-607e77761e52 service nova] Releasing lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-changed-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG nova.compute.manager [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Refreshing instance network info cache due to event network-changed-25caa6e9-828b-4876-9be1-ab3cc1a643f2. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] Acquiring lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] Acquired lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Refreshing network info cache for port 25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'flavor' on Instance uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:28:48 user nova-compute[74534]: INFO nova.compute.manager [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Attaching volume 3d9d3415-9d73-43c9-9373-72a7db85cd86 to /dev/vdb
Nov 02 12:28:48 user nova-compute[74534]: DEBUG os_brick.utils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb222c-b64a-4ee4-a2cd-e5e8161566a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd5950-966c-4ceb-8509-871cfd741273]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3735adc-6213-4f65-a52f-728054d19d03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[585ab153-968e-4e30-bdca-5fed8f526cd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updated VIF entry in instance network info cache for port 25caa6e9-828b-4876-9be1-ab3cc1a643f2. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:28:48 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b80f49b-084b-4395-81a7-2899f5d5fd3b]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG os_brick.utils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating existing volume attachment record: a9552cbe-219b-4fba-9d2b-ef2e01bacf4e {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:28:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2d064258-d384-4016-be5f-fc334275cfb0 req-e3fe9750-7a97-47d7-a42b-7993e4df1335 service nova] Releasing lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:28:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:28:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsOKbgph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:29:07 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:29:07 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:29:07 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[daccd4b6-0141-4d0c-99e7-be182a9dade3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:29:07 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b371cb71-0cab-4929-876a-e365dcf00cd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86] added
Nov 02 12:29:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5843e95d-4a0d-4241-ab7f-cbeb9d39b5a3]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7b7493-a16e-41f7-88ee-92665222754b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsOKbgph {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsOKbgph" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe5322-8dae-4dc5-aff6-a7eb968d9880]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rsOKbgph'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0199465-63ba-4fa4-921a-355132e0b5d3]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f36274-f539-4995-a818-bc3672add135]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:29:07 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:29:07 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:29:07 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:29:07 user nova-compute[74534]: 
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c14b60-5967-4bc2-94f6-0c242d39d228]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260]
Nov 02 12:29:07 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260] successful.
Nov 02 12:29:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacecf2f-61db-4667-b030-19f5036714b2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[34124c81-d657-438e-9739-89cdb69a40ac]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 (non-flash)
Nov 02 12:29:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 (non-flash)
Nov 02 12:29:07 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[840ac8bb-f1af-4d2b-b3ab-dae4f7c7c007]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:07 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:29:08 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:29:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsOKbgph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:29:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:29:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26439646662643739', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:29:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439646662643739', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:29:08 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'flavor' on Instance uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:29:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:29:09 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:29:09 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:29:09 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:29:09 user nova-compute[74534]:   <serial>3d9d3415-9d73-43c9-9373-72a7db85cd86</serial>
Nov 02 12:29:09 user nova-compute[74534]: </disk>
Nov 02 12:29:09 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:29:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:29:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:29:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No VIF found with MAC fa:16:3e:39:93:fc, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:29:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d79e80b1-9f35-4e62-9c64-fd32d6f9d9fa tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.284s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:12 user nova-compute[74534]: INFO nova.compute.manager [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Detaching volume 3d9d3415-9d73-43c9-9373-72a7db85cd86
Nov 02 12:29:12 user nova-compute[74534]: INFO nova.virt.block_device [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Attempting to driver detach volume 3d9d3415-9d73-43c9-9373-72a7db85cd86 from mountpoint /dev/vdb
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Attempting to detach device vdb from instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:29:12 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:29:12 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:29:12 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:29:12 user nova-compute[74534]:   <serial>3d9d3415-9d73-43c9-9373-72a7db85cd86</serial>
Nov 02 12:29:12 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:29:12 user nova-compute[74534]: </disk>
Nov 02 12:29:12 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:29:12 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully detached device vdb from instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 from the persistent domain config.
Nov 02 12:29:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:29:12 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:29:12 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:29:12 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:29:12 user nova-compute[74534]:   <serial>3d9d3415-9d73-43c9-9373-72a7db85cd86</serial>
Nov 02 12:29:12 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:29:12 user nova-compute[74534]: </disk>
Nov 02 12:29:12 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:29:13 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:29:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=25.087982177734375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90d26a35-e2a4-4f31-bc84-579e2ab28798 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:29:13 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'flavor' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:14 user nova-compute[74534]: INFO nova.compute.manager [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Attaching volume 3be9142c-9245-41fd-afbf-2245b91133a5 to /dev/vdb
Nov 02 12:29:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[63593745-3557-43f1-8425-ac808c26bdaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3339d8-2636-4b80-98bc-8c1a07dd6942]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24b9b03-640b-4c67-958d-fcd5df2960bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[129690cc-a671-4543-898e-7c032206086c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:29:14 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:29:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4ea2b1-56fe-4aab-8fdf-03f399077338]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:29:14 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating existing volume attachment record: 78173d1e-de6c-4c49-8d97-e5093a5086e1 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:29:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:29:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:29:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:29:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:27 user nova-compute[74534]: INFO nova.compute.manager [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Terminating instance
Nov 02 12:29:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-47a977fc-f8c8-4673-bbaa-bc1a42519637 req-4e9104b9-71ea-41dc-9be1-f5d6b7d99d55 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-47a977fc-f8c8-4673-bbaa-bc1a42519637 req-4e9104b9-71ea-41dc-9be1-f5d6b7d99d55 service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-47a977fc-f8c8-4673-bbaa-bc1a42519637 req-4e9104b9-71ea-41dc-9be1-f5d6b7d99d55 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-47a977fc-f8c8-4673-bbaa-bc1a42519637 req-4e9104b9-71ea-41dc-9be1-f5d6b7d99d55 service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-47a977fc-f8c8-4673-bbaa-bc1a42519637 req-4e9104b9-71ea-41dc-9be1-f5d6b7d99d55 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:29:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-47a977fc-f8c8-4673-bbaa-bc1a42519637 req-4e9104b9-71ea-41dc-9be1-f5d6b7d99d55 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Instance destroyed successfully.
Nov 02 12:29:28 user nova-compute[74534]: DEBUG nova.objects.instance [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lazy-loading 'resources' on Instance uuid 90d26a35-e2a4-4f31-bc84-579e2ab28798 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-771521797',display_name='tempest-ServerRescueNegativeTestJSON-server-771521797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-771521797',id=20,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294df1c916c248d496812d8b2bb1b57e',ramdisk_id='',reservation_id='r-i1b2l74y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-158551613',owner_user_name='tempest-ServerRescueNegativeTestJSON-158551613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:18:31Z,user_data=None,user_id='c0dabe5e283645a382a1f0bf6ab7ddf1',uuid=90d26a35-e2a4-4f31-bc84-579e2ab28798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converting VIF {"id": "0ac87943-5280-44ef-9afa-523d2b996e19", "address": "fa:16:3e:0c:a6:a3", "network": {"id": "31f8cdd1-64c9-4efc-bddf-87d774534fde", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-800534913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294df1c916c248d496812d8b2bb1b57e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac87943-52", "ovs_interfaceid": "0ac87943-5280-44ef-9afa-523d2b996e19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG os_vif [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ac87943-52, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=119e43b5-e447-482c-a532-1e7e1fbe9f10) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: INFO os_vif [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a6:a3,bridge_name='br-int',has_traffic_filtering=True,id=0ac87943-5280-44ef-9afa-523d2b996e19,network=Network(31f8cdd1-64c9-4efc-bddf-87d774534fde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac87943-52')
Nov 02 12:29:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Deleting instance files /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798_del
Nov 02 12:29:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Deletion of /opt/stack/data/nova/instances/90d26a35-e2a4-4f31-bc84-579e2ab28798_del complete
Nov 02 12:29:28 user nova-compute[74534]: INFO nova.compute.manager [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 12:29:28 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:29:29 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Took 0.88 seconds to deallocate network for instance.
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-a801811a-b839-448f-8f4b-97f19046c06c req-ae5bf04d-cdee-460d-ab29-7b6f195a3995 service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-deleted-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:29 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Deleted allocations for instance 90d26a35-e2a4-4f31-bc84-579e2ab28798
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b64d7207-44db-407c-895f-4f4cb82751e0 tempest-ServerRescueNegativeTestJSON-158551613 tempest-ServerRescueNegativeTestJSON-158551613-project-member] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:29:29 user nova-compute[74534]: WARNING nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state deleted and task_state None.
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:29:29 user nova-compute[74534]: WARNING nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state deleted and task_state None.
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:29:29 user nova-compute[74534]: WARNING nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state deleted and task_state None.
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:29:29 user nova-compute[74534]: WARNING nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-unplugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state deleted and task_state None.
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Acquiring lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] Lock "90d26a35-e2a4-4f31-bc84-579e2ab28798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] No waiting events found dispatching network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:29:29 user nova-compute[74534]: WARNING nova.compute.manager [req-03c30a7e-c237-4659-932e-c7f8fe8e6741 req-83c790a2-5c55-499e-a3dc-e2d8e2f3352f service nova] [instance: 90d26a35-e2a4-4f31-bc84-579e2ab28798] Received unexpected event network-vif-plugged-0ac87943-5280-44ef-9afa-523d2b996e19 for instance with vm_state deleted and task_state None.
Nov 02 12:29:32 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 is timed out.
Nov 02 12:29:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully detached device vdb from instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 from the live domain config.
Nov 02 12:29:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:29:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsOKbgph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:29:32 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:29:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:29:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:29:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cb3ba3-f3c8-408c-ab94-e9eb4a46d957]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:29:33 user nova-compute[74534]: No targets found.
Nov 02 12:29:33 user nova-compute[74534]: iSNS:
Nov 02 12:29:33 user nova-compute[74534]: No targets found.
Nov 02 12:29:33 user nova-compute[74534]: STATIC:
Nov 02 12:29:33 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86
Nov 02 12:29:33 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:29:33 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:29:33 user nova-compute[74534]: FIRMWARE:
Nov 02 12:29:33 user nova-compute[74534]: No targets found.
Nov 02 12:29:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:29:33 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:29:33 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4795c19d-a384-4295-8fe3-e0a68a0094f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ccaa71-c5ba-480c-b2dc-66f932f5c37e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 (non-flash)
Nov 02 12:29:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 (non-flash)
Nov 02 12:29:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180666ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a2a1a2-ff3a-4530-b324-567c31da3087]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[32253a83-113e-48d2-b791-c885745a5b23]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b5eb72-0fb3-4971-9ecf-c7c7d35d773b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd5e399-cf22-42a0-a6de-2a9469282cee]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4287b0f-fefb-4e5d-a732-f267f427093f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe841dd-c4fa-4cf6-9149-32c3e040a968]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260]
Nov 02 12:29:33 user nova-compute[74534]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86, portal: 172.16.0.220,3260] successful.
Nov 02 12:29:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9d3415-9d73-43c9-9373-72a7db85cd86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b709dca3-1f10-43de-879b-9dcfdfed2f8c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] <== disconnect_volume: return (271ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:29:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:29:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'flavor' on Instance uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:29:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-913059b3-28ac-4601-8ef0-129d497c6ebc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.802s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:29:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:29:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:29:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:29:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:29:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:29:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:29:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYIRaZbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:29:50 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:29:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:29:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:29:50 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:29:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:29:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:29:50 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:29:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[337a46a1-7d91-4128-8071-a0bb53794329]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:29:51 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3f5f3-aea3-4503-8a26-72d04e4ea90a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5] added
Nov 02 12:29:51 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b27a29-05c7-4c92-925c-93d0662e8e8e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11d8705-339b-4640-855e-8dfb89cd220d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYIRaZbP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYIRaZbP" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3c299-d82c-4494-8ed8-886b136c5e44]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kYIRaZbP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ec9d04-ff9f-4f4c-ab58-139119523580]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3edff3-7d6b-4c4e-9bfd-2940b41e38ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:29:51 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:29:51 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:29:51 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:29:51 user nova-compute[74534]: 
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36dadcb-160b-47e4-ac2e-8a9bb9e19b5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]
Nov 02 12:29:51 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.
Nov 02 12:29:51 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b922a9-d539-4e7d-9808-45665cec5c72]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[529a3295-af38-470d-9e80-7d0911b34cdc]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:29:51 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:29:51 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[80235c70-a96c-4b62-96e2-5beffde76e7b]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:29:51 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYIRaZbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23732633336373431', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732633336373431', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'flavor' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:29:52 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:29:52 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:29:52 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:29:52 user nova-compute[74534]:   <serial>3be9142c-9245-41fd-afbf-2245b91133a5</serial>
Nov 02 12:29:52 user nova-compute[74534]: </disk>
Nov 02 12:29:52 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No VIF found with MAC fa:16:3e:06:1e:30, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:29:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-64d43f43-b3d9-4ec8-9be9-dcd737094fe6 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.252s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:29:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:29:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:29:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:29:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:29:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:29:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing instance network info cache due to event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updated VIF entry in instance network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-42afb0e9-882a-454c-bc58-55a0d06ed7c3 req-e288c8a8-7a3b-4d2d-a674-75e86d4c633a service nova] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing instance network info cache due to event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:30:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updated VIF entry in instance network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ebf28fdb-0c0a-4f81-b839-006ec0492196 req-31b61517-de89-4fed-b4a0-dc1552407a31 service nova] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:30:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:30:15 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=25.089008331298828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:30:15 user nova-compute[74534]: INFO nova.compute.manager [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] instance snapshotting
Nov 02 12:30:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Beginning live snapshot process
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:15 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json -f qcow2 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.224s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptg6a3q22/cc6c2609f7274937812b42bb1a57a697.delta 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptg6a3q22/cc6c2609f7274937812b42bb1a57a697.delta 1073741824" returned: 0 in 0.066s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74534) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 12:30:17 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptg6a3q22/cc6c2609f7274937812b42bb1a57a697.delta /opt/stack/data/nova/instances/snapshots/tmptg6a3q22/cc6c2609f7274937812b42bb1a57a697 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:30:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptg6a3q22/cc6c2609f7274937812b42bb1a57a697.delta /opt/stack/data/nova/instances/snapshots/tmptg6a3q22/cc6c2609f7274937812b42bb1a57a697" returned: 0 in 0.722s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:18 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Snapshot extracted, beginning image upload
Nov 02 12:30:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Snapshot image upload complete
Nov 02 12:30:21 user nova-compute[74534]: INFO nova.compute.manager [None req-dbfe9bfd-5700-4333-b199-74cb00cb86fc tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Took 6.02 seconds to snapshot the instance on the hypervisor.
Nov 02 12:30:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:30:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:23 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:30:23 user nova-compute[74534]: INFO nova.compute.claims [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Claim successful on node user
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:30:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.policy [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45f09340dc9451fbed7968edcfbe0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069eff35ce894007921aee633a568ef7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:30:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Creating image(s)
Nov 02 12:30:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "/opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "/opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "26b56188e607bb1e90bc3e5e2d2974ed66fce2de" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "26b56188e607bb1e90bc3e5e2d2974ed66fce2de" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Successfully created port: 82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:30:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.part --force-share --output=json" returned: 0 in 0.223s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:25 user nova-compute[74534]: DEBUG nova.virt.images [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] 66883a3a-bd33-4944-925f-1cc92235e36e was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:30:25 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:30:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.part /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.part /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.converted" returned: 0 in 0.992s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Successfully updated port: 82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:30:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquired lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:26 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:27 user nova-compute[74534]: INFO nova.compute.manager [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Rebooting instance
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-changed-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Refreshing instance network info cache due to event network-changed-82174c92-9a75-4be9-b6b1-8e146aa46856. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] Acquiring lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de.converted --force-share --output=json" returned: 0 in 0.278s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "26b56188e607bb1e90bc3e5e2d2974ed66fce2de" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.686s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de --force-share --output=json" returned: 0 in 0.232s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "26b56188e607bb1e90bc3e5e2d2974ed66fce2de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "26b56188e607bb1e90bc3e5e2d2974ed66fce2de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updating instance_info_cache with network_info: [{"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Releasing lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Instance network_info: |[{"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] Acquired lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.network.neutron [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Refreshing network info cache for port 82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de --force-share --output=json" returned: 0 in 0.240s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de,backing_fmt=raw /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de,backing_fmt=raw /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk 1073741824" returned: 0 in 0.066s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "26b56188e607bb1e90bc3e5e2d2974ed66fce2de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Ensure instance console log exists: /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Start _get_guest_xml network_info=[{"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e2295916ba2e274c7ce8bdf60618c5ef',container_format='bare',created_at=2023-11-02T12:30:15Z,direct_url=<?>,disk_format='qcow2',id=66883a3a-bd33-4944-925f-1cc92235e36e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1711169641',owner='069eff35ce894007921aee633a568ef7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T12:30:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '66883a3a-bd33-4944-925f-1cc92235e36e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:30:27 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:30:27 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e2295916ba2e274c7ce8bdf60618c5ef',container_format='bare',created_at=2023-11-02T12:30:15Z,direct_url=<?>,disk_format='qcow2',id=66883a3a-bd33-4944-925f-1cc92235e36e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1711169641',owner='069eff35ce894007921aee633a568ef7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T12:30:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:30:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-548682608',display_name='tempest-TestStampPattern-server-548682608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-548682608',id=40,image_ref='66883a3a-bd33-4944-925f-1cc92235e36e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyesrse4Qmq0ljOTmJgUTPa80HlhGnznrWykxLsmeImeZmN0A/GNbPvkdqHaACktMD5zWY+kSTDiHn+TnqzzL/Kc+0idjnFHn3YoqoNxZu+ax4JBkG40G4iIxC7qKcBNA==',key_name='tempest-TestStampPattern-920487778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069eff35ce894007921aee633a568ef7',ramdisk_id='',reservation_id='r-30h83697',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8f8b285e-6679-47f5-9467-ae6d788ea0f6',image_min_disk='1',image_min_ram='0',image_owner_id='069eff35ce894007921aee633a568ef7',image_owner_project_name='tempest-TestStampPattern-1394267046',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1394267046-project-member',image_user_id='e45f09340dc9451fbed7968edcfbe0ff',network_allocated='True',owner_project_name='tempest-TestStampPattern-1394267046',owner_user_name='tempest-TestStampPattern-1394267046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:30:24Z,user_data=None,user_id='e45f09340dc9451fbed7968edcfbe0ff',uuid=0a9fb1cc-b34b-4880-addd-481c5e9fa4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converting VIF {"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:fb:e7,bridge_name='br-int',has_traffic_filtering=True,id=82174c92-9a75-4be9-b6b1-8e146aa46856,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82174c92-9a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:30:28 user nova-compute[74534]:   <uuid>0a9fb1cc-b34b-4880-addd-481c5e9fa4a0</uuid>
Nov 02 12:30:28 user nova-compute[74534]:   <name>instance-00000028</name>
Nov 02 12:30:28 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:30:28 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:30:28 user nova-compute[74534]:   <metadata>
Nov 02 12:30:28 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:30:28 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:30:28 user nova-compute[74534]:       <nova:name>tempest-TestStampPattern-server-548682608</nova:name>
Nov 02 12:30:28 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:30:27</nova:creationTime>
Nov 02 12:30:28 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:30:28 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:30:28 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:30:28 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:30:28 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:30:28 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:30:28 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:30:28 user nova-compute[74534]:       <nova:owner>
Nov 02 12:30:28 user nova-compute[74534]:         <nova:user uuid="e45f09340dc9451fbed7968edcfbe0ff">tempest-TestStampPattern-1394267046-project-member</nova:user>
Nov 02 12:30:28 user nova-compute[74534]:         <nova:project uuid="069eff35ce894007921aee633a568ef7">tempest-TestStampPattern-1394267046</nova:project>
Nov 02 12:30:28 user nova-compute[74534]:       </nova:owner>
Nov 02 12:30:28 user nova-compute[74534]:       <nova:root type="image" uuid="66883a3a-bd33-4944-925f-1cc92235e36e"/>
Nov 02 12:30:28 user nova-compute[74534]:       <nova:ports>
Nov 02 12:30:28 user nova-compute[74534]:         <nova:port uuid="82174c92-9a75-4be9-b6b1-8e146aa46856">
Nov 02 12:30:28 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 12:30:28 user nova-compute[74534]:         </nova:port>
Nov 02 12:30:28 user nova-compute[74534]:       </nova:ports>
Nov 02 12:30:28 user nova-compute[74534]:     </nova:instance>
Nov 02 12:30:28 user nova-compute[74534]:   </metadata>
Nov 02 12:30:28 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:30:28 user nova-compute[74534]:     <system>
Nov 02 12:30:28 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:30:28 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:30:28 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:30:28 user nova-compute[74534]:       <entry name="serial">0a9fb1cc-b34b-4880-addd-481c5e9fa4a0</entry>
Nov 02 12:30:28 user nova-compute[74534]:       <entry name="uuid">0a9fb1cc-b34b-4880-addd-481c5e9fa4a0</entry>
Nov 02 12:30:28 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:30:28 user nova-compute[74534]:     </system>
Nov 02 12:30:28 user nova-compute[74534]:   </sysinfo>
Nov 02 12:30:28 user nova-compute[74534]:   <os>
Nov 02 12:30:28 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:30:28 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:30:28 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:30:28 user nova-compute[74534]:   </os>
Nov 02 12:30:28 user nova-compute[74534]:   <features>
Nov 02 12:30:28 user nova-compute[74534]:     <acpi/>
Nov 02 12:30:28 user nova-compute[74534]:     <apic/>
Nov 02 12:30:28 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:30:28 user nova-compute[74534]:   </features>
Nov 02 12:30:28 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:30:28 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:30:28 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:30:28 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:30:28 user nova-compute[74534]:   </clock>
Nov 02 12:30:28 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:30:28 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:30:28 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:30:28 user nova-compute[74534]:   </cpu>
Nov 02 12:30:28 user nova-compute[74534]:   <devices>
Nov 02 12:30:28 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:30:28 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:30:28 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk"/>
Nov 02 12:30:28 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:30:28 user nova-compute[74534]:     </disk>
Nov 02 12:30:28 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:30:28 user nova-compute[74534]:       <mac address="fa:16:3e:46:fb:e7"/>
Nov 02 12:30:28 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:30:28 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:30:28 user nova-compute[74534]:       <target dev="tap82174c92-9a"/>
Nov 02 12:30:28 user nova-compute[74534]:     </interface>
Nov 02 12:30:28 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:30:28 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/console.log" append="off"/>
Nov 02 12:30:28 user nova-compute[74534]:     </serial>
Nov 02 12:30:28 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:30:28 user nova-compute[74534]:     <video>
Nov 02 12:30:28 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:30:28 user nova-compute[74534]:     </video>
Nov 02 12:30:28 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:30:28 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:30:28 user nova-compute[74534]:     </rng>
Nov 02 12:30:28 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:30:28 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:30:28 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:30:28 user nova-compute[74534]:     </memballoon>
Nov 02 12:30:28 user nova-compute[74534]:   </devices>
Nov 02 12:30:28 user nova-compute[74534]: </domain>
Nov 02 12:30:28 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-548682608',display_name='tempest-TestStampPattern-server-548682608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-548682608',id=40,image_ref='66883a3a-bd33-4944-925f-1cc92235e36e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyesrse4Qmq0ljOTmJgUTPa80HlhGnznrWykxLsmeImeZmN0A/GNbPvkdqHaACktMD5zWY+kSTDiHn+TnqzzL/Kc+0idjnFHn3YoqoNxZu+ax4JBkG40G4iIxC7qKcBNA==',key_name='tempest-TestStampPattern-920487778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069eff35ce894007921aee633a568ef7',ramdisk_id='',reservation_id='r-30h83697',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8f8b285e-6679-47f5-9467-ae6d788ea0f6',image_min_disk='1',image_min_ram='0',image_owner_id='069eff35ce894007921aee633a568ef7',image_owner_project_name='tempest-TestStampPattern-1394267046',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1394267046-project-member',image_user_id='e45f09340dc9451fbed7968edcfbe0ff',network_allocated='True',owner_project_name='tempest-TestStampPattern-1394267046',owner_user_name='tempest-TestStampPattern-1394267046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:30:24Z,user_data=None,user_id='e45f09340dc9451fbed7968edcfbe0ff',uuid=0a9fb1cc-b34b-4880-addd-481c5e9fa4a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converting VIF {"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:fb:e7,bridge_name='br-int',has_traffic_filtering=True,id=82174c92-9a75-4be9-b6b1-8e146aa46856,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82174c92-9a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG os_vif [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:fb:e7,bridge_name='br-int',has_traffic_filtering=True,id=82174c92-9a75-4be9-b6b1-8e146aa46856,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82174c92-9a') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '389a436a-14e7-5bb2-a03b-64ba15aa6760', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.network.neutron [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updated VIF entry in instance network info cache for port 82174c92-9a75-4be9-b6b1-8e146aa46856. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.network.neutron [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updating instance_info_cache with network_info: [{"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82174c92-9a, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82174c92-9a, col_values=(('qos', UUID('cebdfc11-b8ad-4213-8848-1a27532cf36f')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82174c92-9a, col_values=(('external_ids', {'iface-id': '82174c92-9a75-4be9-b6b1-8e146aa46856', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:fb:e7', 'vm-uuid': '0a9fb1cc-b34b-4880-addd-481c5e9fa4a0'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ebcf6ce1-28b5-4e59-a807-6973eafeba47 req-cf8d7e01-5048-4fc5-94ec-119cba862d02 service nova] Releasing lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: INFO os_vif [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:fb:e7,bridge_name='br-int',has_traffic_filtering=True,id=82174c92-9a75-4be9-b6b1-8e146aa46856,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82174c92-9a')
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No VIF found with MAC fa:16:3e:46:fb:e7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-88a030e8-40cd-42a4-88cf-6abf49c2bda0 req-dd4ab1d6-e7a0-4032-8cd0-4b86e9b65fc1 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-unplugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-88a030e8-40cd-42a4-88cf-6abf49c2bda0 req-dd4ab1d6-e7a0-4032-8cd0-4b86e9b65fc1 service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-88a030e8-40cd-42a4-88cf-6abf49c2bda0 req-dd4ab1d6-e7a0-4032-8cd0-4b86e9b65fc1 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-88a030e8-40cd-42a4-88cf-6abf49c2bda0 req-dd4ab1d6-e7a0-4032-8cd0-4b86e9b65fc1 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-88a030e8-40cd-42a4-88cf-6abf49c2bda0 req-dd4ab1d6-e7a0-4032-8cd0-4b86e9b65fc1 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-unplugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:30:28 user nova-compute[74534]: WARNING nova.compute.manager [req-88a030e8-40cd-42a4-88cf-6abf49c2bda0 req-dd4ab1d6-e7a0-4032-8cd0-4b86e9b65fc1 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received unexpected event network-vif-unplugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with vm_state active and task_state reboot_started_hard.
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance destroyed successfully.
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'resources' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-206304309',display_name='tempest-TestMinimumBasicScenario-server-206304309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-206304309',id=39,image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX+1vJdxfDhEoA+PYRIdI4ZHl4tNejUTJrRclUGhD/BKh07FxLguVTLoFVhqKuZ0rAPm9kdF6Jxb76pP4CEB6hfPDIG+3jkWPsyS38GhuC5KV8u5MSqFMQ49KoKVcgweA==',key_name='tempest-TestMinimumBasicScenario-2038886643',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-hfe32l35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:30:28Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1e1b3a51-03ea-431a-b2fe-8227c4180832,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_vif [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00ac64e9-c6, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b860210-148e-4be1-8568-b53c8a668dd6) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: INFO os_vif [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6')
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYIRaZbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:30:29 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7def876-61fe-4bde-87b2-1ddcc8cad81c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:30:29 user nova-compute[74534]: No targets found.
Nov 02 12:30:29 user nova-compute[74534]: iSNS:
Nov 02 12:30:29 user nova-compute[74534]: No targets found.
Nov 02 12:30:29 user nova-compute[74534]: STATIC:
Nov 02 12:30:29 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5
Nov 02 12:30:29 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:30:29 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:30:29 user nova-compute[74534]: FIRMWARE:
Nov 02 12:30:29 user nova-compute[74534]: No targets found.
Nov 02 12:30:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:30:29 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:30:29 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7d30d-c7e9-4c70-8fc8-480ee6762f29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd18c510-6873-4bd9-9956-715b4b6e8c38]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:30:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:30:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1807c8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f87e55-a82e-43ec-bbe0-bd99367fa56d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[754a71b9-67de-4db5-93a1-173e25f4967e]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[79504e0b-a75f-4626-b11d-817859c08f2d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c43c7-2c9c-4c45-9317-7483c48dcbc3]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c69563-c8d1-4dfa-8a95-34251810cad1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[588f632d-8fe5-481c-b4d2-0375bb2700e0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]
Nov 02 12:30:29 user nova-compute[74534]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.
Nov 02 12:30:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0948cd8-bad0-4396-8684-8fbf2f32b580]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== disconnect_volume: return (312ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Start _get_guest_xml network_info=[{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=acb5348a-8967-4a94-a78d-0047e3acbebd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'acb5348a-8967-4a94-a78d-0047e3acbebd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'guest_format': None, 'attachment_id': '78173d1e-de6c-4c49-8d97-e5093a5086e1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYIRaZbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1e1b3a51-03ea-431a-b2fe-8227c4180832', 'attached_at': '', 'detached_at': '', 'volume_id': '3be9142c-9245-41fd-afbf-2245b91133a5', 'serial': '3be9142c-9245-41fd-afbf-2245b91133a5'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:30:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:30:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=acb5348a-8967-4a94-a78d-0047e3acbebd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.objects.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Object Instance<1e1b3a51-03ea-431a-b2fe-8227c4180832> lazy-loaded attributes: resources,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYIRaZbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:30:29 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:30:29 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:30:29 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[20725410-f55a-48cf-9963-7168598e98a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:30:29 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf1b87-532e-4eb5-9d7d-a7039f9432e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5] added
Nov 02 12:30:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acb9c0d-4220-461f-bb2e-69015da2e5d0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9353a4b4-0c30-4243-812d-43a0552d215b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYIRaZbP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kYIRaZbP" returned: 0 in 0.027s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1867abca-615a-4296-8263-c8160b13bc4d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kYIRaZbP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8cc988-74b2-43fe-9275-269f634bec3a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[775cbd8e-47a7-45ad-8bac-df8fcb84e1bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:30:29 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:30:29 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:30:29 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:30:29 user nova-compute[74534]: 
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb3e4b0-9453-4b2b-8f82-cbb5989de4bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]
Nov 02 12:30:29 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.
Nov 02 12:30:29 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[208f23dc-d4a7-4d79-8e3d-9e378c0fcbd4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd00095-cafe-46f6-aee9-304279cf264c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:30:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:30:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[997d57aa-2b81-4d3f-a943-fd19fec5c7d8]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYIRaZbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-bf423d46-63c8-4a79-8488-ccf1afb792b0 req-7c881481-65cf-4c89-b6f0-d674c4e1e227 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bf423d46-63c8-4a79-8488-ccf1afb792b0 req-7c881481-65cf-4c89-b6f0-d674c4e1e227 service nova] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bf423d46-63c8-4a79-8488-ccf1afb792b0 req-7c881481-65cf-4c89-b6f0-d674c4e1e227 service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bf423d46-63c8-4a79-8488-ccf1afb792b0 req-7c881481-65cf-4c89-b6f0-d674c4e1e227 service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-bf423d46-63c8-4a79-8488-ccf1afb792b0 req-7c881481-65cf-4c89-b6f0-d674c4e1e227 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] No waiting events found dispatching network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:30:30 user nova-compute[74534]: WARNING nova.compute.manager [req-bf423d46-63c8-4a79-8488-ccf1afb792b0 req-7c881481-65cf-4c89-b6f0-d674c4e1e227 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received unexpected event network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 for instance with vm_state building and task_state spawning.
Nov 02 12:30:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-f25368c5-251b-4660-9bd5-73c2c7213630 req-6495a06d-22d9-4ca6-92d0-f35125c2d4f8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f25368c5-251b-4660-9bd5-73c2c7213630 req-6495a06d-22d9-4ca6-92d0-f35125c2d4f8 service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f25368c5-251b-4660-9bd5-73c2c7213630 req-6495a06d-22d9-4ca6-92d0-f35125c2d4f8 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f25368c5-251b-4660-9bd5-73c2c7213630 req-6495a06d-22d9-4ca6-92d0-f35125c2d4f8 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-f25368c5-251b-4660-9bd5-73c2c7213630 req-6495a06d-22d9-4ca6-92d0-f35125c2d4f8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:30:30 user nova-compute[74534]: WARNING nova.compute.manager [req-f25368c5-251b-4660-9bd5-73c2c7213630 req-6495a06d-22d9-4ca6-92d0-f35125c2d4f8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received unexpected event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with vm_state active and task_state reboot_started_hard.
Nov 02 12:30:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23732633336373431', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732633336373431', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-206304309',display_name='tempest-TestMinimumBasicScenario-server-206304309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-206304309',id=39,image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX+1vJdxfDhEoA+PYRIdI4ZHl4tNejUTJrRclUGhD/BKh07FxLguVTLoFVhqKuZ0rAPm9kdF6Jxb76pP4CEB6hfPDIG+3jkWPsyS38GhuC5KV8u5MSqFMQ49KoKVcgweA==',key_name='tempest-TestMinimumBasicScenario-2038886643',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-hfe32l35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:30:28Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1e1b3a51-03ea-431a-b2fe-8227c4180832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.objects.instance [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.objects.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Object Instance<1e1b3a51-03ea-431a-b2fe-8227c4180832> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:30:31 user nova-compute[74534]:   <uuid>1e1b3a51-03ea-431a-b2fe-8227c4180832</uuid>
Nov 02 12:30:31 user nova-compute[74534]:   <name>instance-00000027</name>
Nov 02 12:30:31 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:30:31 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:30:31 user nova-compute[74534]:   <metadata>
Nov 02 12:30:31 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:30:31 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:30:31 user nova-compute[74534]:       <nova:name>tempest-TestMinimumBasicScenario-server-206304309</nova:name>
Nov 02 12:30:31 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:30:29</nova:creationTime>
Nov 02 12:30:31 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:30:31 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:30:31 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:30:31 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:30:31 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:30:31 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:30:31 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:30:31 user nova-compute[74534]:       <nova:owner>
Nov 02 12:30:31 user nova-compute[74534]:         <nova:user uuid="dac1b3b4e45d42839c9a9413baa0fcec">tempest-TestMinimumBasicScenario-388517270-project-member</nova:user>
Nov 02 12:30:31 user nova-compute[74534]:         <nova:project uuid="1851244b13ac4d26a5ffabc047210b4d">tempest-TestMinimumBasicScenario-388517270</nova:project>
Nov 02 12:30:31 user nova-compute[74534]:       </nova:owner>
Nov 02 12:30:31 user nova-compute[74534]:       <nova:root type="image" uuid="acb5348a-8967-4a94-a78d-0047e3acbebd"/>
Nov 02 12:30:31 user nova-compute[74534]:       <nova:ports>
Nov 02 12:30:31 user nova-compute[74534]:         <nova:port uuid="00ac64e9-c6c7-4f1f-8288-75daf01fca5b">
Nov 02 12:30:31 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:30:31 user nova-compute[74534]:         </nova:port>
Nov 02 12:30:31 user nova-compute[74534]:       </nova:ports>
Nov 02 12:30:31 user nova-compute[74534]:     </nova:instance>
Nov 02 12:30:31 user nova-compute[74534]:   </metadata>
Nov 02 12:30:31 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:30:31 user nova-compute[74534]:     <system>
Nov 02 12:30:31 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:30:31 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:30:31 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:30:31 user nova-compute[74534]:       <entry name="serial">1e1b3a51-03ea-431a-b2fe-8227c4180832</entry>
Nov 02 12:30:31 user nova-compute[74534]:       <entry name="uuid">1e1b3a51-03ea-431a-b2fe-8227c4180832</entry>
Nov 02 12:30:31 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:30:31 user nova-compute[74534]:     </system>
Nov 02 12:30:31 user nova-compute[74534]:   </sysinfo>
Nov 02 12:30:31 user nova-compute[74534]:   <os>
Nov 02 12:30:31 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:30:31 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:30:31 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:30:31 user nova-compute[74534]:   </os>
Nov 02 12:30:31 user nova-compute[74534]:   <features>
Nov 02 12:30:31 user nova-compute[74534]:     <acpi/>
Nov 02 12:30:31 user nova-compute[74534]:     <apic/>
Nov 02 12:30:31 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:30:31 user nova-compute[74534]:   </features>
Nov 02 12:30:31 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:30:31 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:30:31 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:30:31 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:30:31 user nova-compute[74534]:   </clock>
Nov 02 12:30:31 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:30:31 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:30:31 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:30:31 user nova-compute[74534]:   </cpu>
Nov 02 12:30:31 user nova-compute[74534]:   <devices>
Nov 02 12:30:31 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:30:31 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:30:31 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk"/>
Nov 02 12:30:31 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:30:31 user nova-compute[74534]:     </disk>
Nov 02 12:30:31 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:30:31 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:30:31 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:30:31 user nova-compute[74534]:       <target dev="vdb" bus="virtio"/>
Nov 02 12:30:31 user nova-compute[74534]:       <serial>3be9142c-9245-41fd-afbf-2245b91133a5</serial>
Nov 02 12:30:31 user nova-compute[74534]:     </disk>
Nov 02 12:30:31 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:30:31 user nova-compute[74534]:       <mac address="fa:16:3e:06:1e:30"/>
Nov 02 12:30:31 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:30:31 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:30:31 user nova-compute[74534]:       <target dev="tap00ac64e9-c6"/>
Nov 02 12:30:31 user nova-compute[74534]:     </interface>
Nov 02 12:30:31 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:30:31 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/console.log" append="off"/>
Nov 02 12:30:31 user nova-compute[74534]:     </serial>
Nov 02 12:30:31 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:30:31 user nova-compute[74534]:     <video>
Nov 02 12:30:31 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:30:31 user nova-compute[74534]:     </video>
Nov 02 12:30:31 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:30:31 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:30:31 user nova-compute[74534]:     </rng>
Nov 02 12:30:31 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:30:31 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:30:31 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:30:31 user nova-compute[74534]:     </memballoon>
Nov 02 12:30:31 user nova-compute[74534]:   </devices>
Nov 02 12:30:31 user nova-compute[74534]: </domain>
Nov 02 12:30:31 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.objects.instance [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.objects.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Object Instance<1e1b3a51-03ea-431a-b2fe-8227c4180832> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Cannot resize image /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.objects.instance [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'migration_context' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.objects.base [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Object Instance<1e1b3a51-03ea-431a-b2fe-8227c4180832> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-206304309',display_name='tempest-TestMinimumBasicScenario-server-206304309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-206304309',id=39,image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX+1vJdxfDhEoA+PYRIdI4ZHl4tNejUTJrRclUGhD/BKh07FxLguVTLoFVhqKuZ0rAPm9kdF6Jxb76pP4CEB6hfPDIG+3jkWPsyS38GhuC5KV8u5MSqFMQ49KoKVcgweA==',key_name='tempest-TestMinimumBasicScenario-2038886643',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-hfe32l35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:30:28Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1e1b3a51-03ea-431a-b2fe-8227c4180832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG os_vif [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64229364-445f-52f3-ab38-44e2e436edd0', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00ac64e9-c6, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00ac64e9-c6, col_values=(('qos', UUID('bba3a2d4-5894-4a6d-b710-f4698bed9648')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00ac64e9-c6, col_values=(('external_ids', {'iface-id': '00ac64e9-c6c7-4f1f-8288-75daf01fca5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:1e:30', 'vm-uuid': '1e1b3a51-03ea-431a-b2fe-8227c4180832'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:30:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:31 user nova-compute[74534]: INFO os_vif [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6')
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-66d2f3dd-9cce-4c5b-b087-2f4f206672d9 req-fda21285-b4ce-481f-8907-436a3b988bf8 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66d2f3dd-9cce-4c5b-b087-2f4f206672d9 req-fda21285-b4ce-481f-8907-436a3b988bf8 service nova] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66d2f3dd-9cce-4c5b-b087-2f4f206672d9 req-fda21285-b4ce-481f-8907-436a3b988bf8 service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66d2f3dd-9cce-4c5b-b087-2f4f206672d9 req-fda21285-b4ce-481f-8907-436a3b988bf8 service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-66d2f3dd-9cce-4c5b-b087-2f4f206672d9 req-fda21285-b4ce-481f-8907-436a3b988bf8 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] No waiting events found dispatching network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:30:32 user nova-compute[74534]: WARNING nova.compute.manager [req-66d2f3dd-9cce-4c5b-b087-2f4f206672d9 req-fda21285-b4ce-481f-8907-436a3b988bf8 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received unexpected event network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 for instance with vm_state building and task_state spawning.
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:30:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Instance spawned successfully.
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:30:32 user nova-compute[74534]: INFO nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Took 7.93 seconds to spawn the instance on the hypervisor.
Nov 02 12:30:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:30:32 user nova-compute[74534]: INFO nova.compute.manager [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Took 8.68 seconds to build instance.
Nov 02 12:30:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e4d71e87-14a3-44e2-9d52-cf46c81e9ca8 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.786s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:32 user nova-compute[74534]: INFO nova.compute.manager [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Unshelving
Nov 02 12:30:32 user nova-compute[74534]: INFO nova.virt.block_device [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Booting with volume fc439c7f-eb15-4b66-844e-6cf8c6548d28 at /dev/vdc
Nov 02 12:30:33 user nova-compute[74534]: DEBUG os_brick.utils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce03a72e-a06b-4316-80c8-f131338aedfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1216d-47ae-4b08-96e3-8f9359aae5c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd062a94-f23a-4e49-acf6-03491ab53951]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fff9e70-8457-4bf2-b0ff-0094f7394740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:30:33 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cba302e-ad94-4cb1-ad62-7b526647ad78]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG os_brick.utils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating existing volume attachment record: 77786720-ac60-47b3-afd4-3e59a7eaa5df {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-8e3437cf-b311-4669-b7c7-d2a61e5fc607 req-e5bb79c6-fcb3-4249-91c8-f0a915751bed service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8e3437cf-b311-4669-b7c7-d2a61e5fc607 req-e5bb79c6-fcb3-4249-91c8-f0a915751bed service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8e3437cf-b311-4669-b7c7-d2a61e5fc607 req-e5bb79c6-fcb3-4249-91c8-f0a915751bed service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8e3437cf-b311-4669-b7c7-d2a61e5fc607 req-e5bb79c6-fcb3-4249-91c8-f0a915751bed service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-8e3437cf-b311-4669-b7c7-d2a61e5fc607 req-e5bb79c6-fcb3-4249-91c8-f0a915751bed service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:30:33 user nova-compute[74534]: WARNING nova.compute.manager [req-8e3437cf-b311-4669-b7c7-d2a61e5fc607 req-e5bb79c6-fcb3-4249-91c8-f0a915751bed service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received unexpected event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with vm_state active and task_state reboot_started_hard.
Nov 02 12:30:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-93c5595e-3c26-43bb-89eb-b61ba07a8925 req-bb102121-21d7-4618-b421-5253b270c407 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-93c5595e-3c26-43bb-89eb-b61ba07a8925 req-bb102121-21d7-4618-b421-5253b270c407 service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-93c5595e-3c26-43bb-89eb-b61ba07a8925 req-bb102121-21d7-4618-b421-5253b270c407 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-93c5595e-3c26-43bb-89eb-b61ba07a8925 req-bb102121-21d7-4618-b421-5253b270c407 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-93c5595e-3c26-43bb-89eb-b61ba07a8925 req-bb102121-21d7-4618-b421-5253b270c407 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:30:35 user nova-compute[74534]: WARNING nova.compute.manager [req-93c5595e-3c26-43bb-89eb-b61ba07a8925 req-bb102121-21d7-4618-b421-5253b270c407 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received unexpected event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with vm_state active and task_state reboot_started_hard.
Nov 02 12:30:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:30:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance rebooted successfully.
Nov 02 12:30:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:30:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-97d48a52-9876-418b-987f-12c873eb6bb7 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.857s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:54 user nova-compute[74534]: DEBUG nova.objects.instance [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'pci_requests' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:54 user nova-compute[74534]: DEBUG nova.objects.instance [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'numa_topology' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:30:54 user nova-compute[74534]: INFO nova.compute.claims [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Claim successful on node user
Nov 02 12:30:55 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:30:55 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:30:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:55 user nova-compute[74534]: INFO nova.network.neutron [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquired lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing instance network info cache due to event network-changed-937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] Acquiring lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.network.neutron [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Releasing lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:30:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Creating image(s)
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'trusted_certs' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] Acquired lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.network.neutron [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Refreshing network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG nova.objects.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<f2b3c95b-d7a3-4be3-b8b5-19b46846cb80> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "a9c3e54c1a11d496d0ec9f45bfa5a9676812be23" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "a9c3e54c1a11d496d0ec9f45bfa5a9676812be23" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.part --force-share --output=json" returned: 0 in 0.236s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:57 user nova-compute[74534]: DEBUG nova.virt.images [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] e184a092-5ee6-47ff-b774-707caa96e880 was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:30:57 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:30:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.part /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updated VIF entry in instance network info cache for port 937f85a3-c324-4e8a-a72c-a81b10a9e8d3. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7dd9210e-590e-4cb9-aff6-1b37a4f7bb56 req-bd24dac6-1332-4db3-bd5a-d42a7ea7dd67 service nova] Releasing lock "refresh_cache-f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.part /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.converted" returned: 0 in 0.552s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "a9c3e54c1a11d496d0ec9f45bfa5a9676812be23" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.912s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23 --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "a9c3e54c1a11d496d0ec9f45bfa5a9676812be23" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "a9c3e54c1a11d496d0ec9f45bfa5a9676812be23" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:30:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23 --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23,backing_fmt=raw /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23,backing_fmt=raw /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk 1073741824" returned: 0 in 0.049s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "a9c3e54c1a11d496d0ec9f45bfa5a9676812be23" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23 --force-share --output=json" returned: 0 in 0.169s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG nova.objects.instance [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'migration_context' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG nova.objects.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<f2b3c95b-d7a3-4be3-b8b5-19b46846cb80> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:30:59 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Rebasing disk image.
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:30:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe -F raw /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe -F raw /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk" returned: 0 in 2.162s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Start _get_guest_xml network_info=[{"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='1d14cd7911ef3b221de61b18e974c7c3',container_format='bare',created_at=2023-11-02T12:28:40Z,direct_url=<?>,disk_format='qcow2',id=e184a092-5ee6-47ff-b774-707caa96e880,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1937524847-shelved',owner='2f367e2b6b094dbcb26fe289d0eda148',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T12:28:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'guest_format': None, 'attachment_id': '77786720-ac60-47b3-afd4-3e59a7eaa5df', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RrqpXfoa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f2b3c95b-d7a3-4be3-b8b5-19b46846cb80', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc439c7f-eb15-4b66-844e-6cf8c6548d28', 'serial': 'fc439c7f-eb15-4b66-844e-6cf8c6548d28'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:31:01 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:31:01 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1d14cd7911ef3b221de61b18e974c7c3',container_format='bare',created_at=2023-11-02T12:28:40Z,direct_url=<?>,disk_format='qcow2',id=e184a092-5ee6-47ff-b774-707caa96e880,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1937524847-shelved',owner='2f367e2b6b094dbcb26fe289d0eda148',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T12:28:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.objects.instance [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.objects.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<f2b3c95b-d7a3-4be3-b8b5-19b46846cb80> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RrqpXfoa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:31:01 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:31:01 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:31:01 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0566b78-eb46-40b1-ba74-6b084ccb3a73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:31:01 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb678a9-6e6d-4fa2-83e5-df4814049225]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28] added
Nov 02 12:31:01 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf99441-a88c-468f-8f21-8c76f6287283]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98a089-5658-492b-8d93-8452ba53de55]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RrqpXfoa {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RrqpXfoa" returned: 0 in 0.083s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[040059b6-f3c8-445e-9be4-ef469534e84b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RrqpXfoa'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:01 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.057s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12bd11a-27a3-4b58-9731-3e0a3014d677]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[50112fec-ef78-4a31-b74f-cd62ae074017]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:31:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:31:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3e5c5e-2064-4bb5-b5c5-8a2ceeb2cfbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260]
Nov 02 12:31:02 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260] successful.
Nov 02 12:31:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe008711-a497-4661-a73d-b632fecf37a2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dec15ea-8e1d-40a4-b333-6422bcd9bfb1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:31:02 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:31:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:31:02 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:31:02 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[65940319-c864-461f-9652-83326c91d672]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RrqpXfoa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:31:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26164646238336563', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164646238336563', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937524847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937524847',id=37,image_ref='e184a092-5ee6-47ff-b774-707caa96e880',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2048841498',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-xrnsj7em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member',shelved_at='2023-11-02T12:28:43.812493',shelved_host='user',shelved_image_id='e184a092-5ee6-47ff-b774-707caa96e880'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=f2b3c95b-d7a3-4be3-b8b5-19b46846cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.objects.instance [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.objects.base [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<f2b3c95b-d7a3-4be3-b8b5-19b46846cb80> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:31:03 user nova-compute[74534]:   <uuid>f2b3c95b-d7a3-4be3-b8b5-19b46846cb80</uuid>
Nov 02 12:31:03 user nova-compute[74534]:   <name>instance-00000025</name>
Nov 02 12:31:03 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:31:03 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:31:03 user nova-compute[74534]:   <metadata>
Nov 02 12:31:03 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:31:03 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:31:03 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1937524847</nova:name>
Nov 02 12:31:03 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:31:01</nova:creationTime>
Nov 02 12:31:03 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:31:03 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:31:03 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:31:03 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:31:03 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:31:03 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:31:03 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:31:03 user nova-compute[74534]:       <nova:owner>
Nov 02 12:31:03 user nova-compute[74534]:         <nova:user uuid="6cc8a90d5468473dae411475ada29ba6">tempest-AttachVolumeShelveTestJSON-616827552-project-member</nova:user>
Nov 02 12:31:03 user nova-compute[74534]:         <nova:project uuid="2f367e2b6b094dbcb26fe289d0eda148">tempest-AttachVolumeShelveTestJSON-616827552</nova:project>
Nov 02 12:31:03 user nova-compute[74534]:       </nova:owner>
Nov 02 12:31:03 user nova-compute[74534]:       <nova:root type="image" uuid="e184a092-5ee6-47ff-b774-707caa96e880"/>
Nov 02 12:31:03 user nova-compute[74534]:       <nova:ports>
Nov 02 12:31:03 user nova-compute[74534]:         <nova:port uuid="937f85a3-c324-4e8a-a72c-a81b10a9e8d3">
Nov 02 12:31:03 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 12:31:03 user nova-compute[74534]:         </nova:port>
Nov 02 12:31:03 user nova-compute[74534]:       </nova:ports>
Nov 02 12:31:03 user nova-compute[74534]:     </nova:instance>
Nov 02 12:31:03 user nova-compute[74534]:   </metadata>
Nov 02 12:31:03 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:31:03 user nova-compute[74534]:     <system>
Nov 02 12:31:03 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:31:03 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:31:03 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:31:03 user nova-compute[74534]:       <entry name="serial">f2b3c95b-d7a3-4be3-b8b5-19b46846cb80</entry>
Nov 02 12:31:03 user nova-compute[74534]:       <entry name="uuid">f2b3c95b-d7a3-4be3-b8b5-19b46846cb80</entry>
Nov 02 12:31:03 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:31:03 user nova-compute[74534]:     </system>
Nov 02 12:31:03 user nova-compute[74534]:   </sysinfo>
Nov 02 12:31:03 user nova-compute[74534]:   <os>
Nov 02 12:31:03 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:31:03 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:31:03 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:31:03 user nova-compute[74534]:   </os>
Nov 02 12:31:03 user nova-compute[74534]:   <features>
Nov 02 12:31:03 user nova-compute[74534]:     <acpi/>
Nov 02 12:31:03 user nova-compute[74534]:     <apic/>
Nov 02 12:31:03 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:31:03 user nova-compute[74534]:   </features>
Nov 02 12:31:03 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:31:03 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:31:03 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:31:03 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:31:03 user nova-compute[74534]:   </clock>
Nov 02 12:31:03 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:31:03 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:31:03 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:31:03 user nova-compute[74534]:   </cpu>
Nov 02 12:31:03 user nova-compute[74534]:   <devices>
Nov 02 12:31:03 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:31:03 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:31:03 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk"/>
Nov 02 12:31:03 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:31:03 user nova-compute[74534]:     </disk>
Nov 02 12:31:03 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:31:03 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:31:03 user nova-compute[74534]:       <source dev="/dev/sdc"/>
Nov 02 12:31:03 user nova-compute[74534]:       <target dev="vdc" bus="virtio"/>
Nov 02 12:31:03 user nova-compute[74534]:       <serial>fc439c7f-eb15-4b66-844e-6cf8c6548d28</serial>
Nov 02 12:31:03 user nova-compute[74534]:     </disk>
Nov 02 12:31:03 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:31:03 user nova-compute[74534]:       <mac address="fa:16:3e:ed:f2:0d"/>
Nov 02 12:31:03 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:31:03 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:31:03 user nova-compute[74534]:       <target dev="tap937f85a3-c3"/>
Nov 02 12:31:03 user nova-compute[74534]:     </interface>
Nov 02 12:31:03 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:31:03 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/console.log" append="off"/>
Nov 02 12:31:03 user nova-compute[74534]:     </serial>
Nov 02 12:31:03 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:31:03 user nova-compute[74534]:     <video>
Nov 02 12:31:03 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:31:03 user nova-compute[74534]:     </video>
Nov 02 12:31:03 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:31:03 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:31:03 user nova-compute[74534]:     </rng>
Nov 02 12:31:03 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:31:03 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:31:03 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:31:03 user nova-compute[74534]:     </memballoon>
Nov 02 12:31:03 user nova-compute[74534]:   </devices>
Nov 02 12:31:03 user nova-compute[74534]: </domain>
Nov 02 12:31:03 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937524847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937524847',id=37,image_ref='e184a092-5ee6-47ff-b774-707caa96e880',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2048841498',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-xrnsj7em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member',shelved_at='2023-11-02T12:28:43.812493',shelved_host='user',shelved_image_id='e184a092-5ee6-47ff-b774-707caa96e880'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=f2b3c95b-d7a3-4be3-b8b5-19b46846cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG os_vif [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '858eb16f-e921-5f94-8991-4f3a6dae6ca6', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap937f85a3-c3, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap937f85a3-c3, col_values=(('qos', UUID('e9b77998-8dc5-45cb-851b-e5cb896e4400')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap937f85a3-c3, col_values=(('external_ids', {'iface-id': '937f85a3-c324-4e8a-a72c-a81b10a9e8d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f2:0d', 'vm-uuid': 'f2b3c95b-d7a3-4be3-b8b5-19b46846cb80'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:03 user nova-compute[74534]: INFO os_vif [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3')
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:31:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No VIF found with MAC fa:16:3e:ed:f2:0d, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-964491b5-0c0a-4661-94a3-69dac6eba7f6 req-52f4f7b7-a94a-4040-9fe2-5b3e10e343fe service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-964491b5-0c0a-4661-94a3-69dac6eba7f6 req-52f4f7b7-a94a-4040-9fe2-5b3e10e343fe service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-964491b5-0c0a-4661-94a3-69dac6eba7f6 req-52f4f7b7-a94a-4040-9fe2-5b3e10e343fe service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-964491b5-0c0a-4661-94a3-69dac6eba7f6 req-52f4f7b7-a94a-4040-9fe2-5b3e10e343fe service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-964491b5-0c0a-4661-94a3-69dac6eba7f6 req-52f4f7b7-a94a-4040-9fe2-5b3e10e343fe service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:31:04 user nova-compute[74534]: WARNING nova.compute.manager [req-964491b5-0c0a-4661-94a3-69dac6eba7f6 req-52f4f7b7-a94a-4040-9fe2-5b3e10e343fe service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received unexpected event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 12:31:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:31:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance spawned successfully.
Nov 02 12:31:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-8b57b2be-7fd4-4544-90e5-c639a6acef46 req-44311938-b2bb-4533-9af4-7fd9629c4379 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8b57b2be-7fd4-4544-90e5-c639a6acef46 req-44311938-b2bb-4533-9af4-7fd9629c4379 service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8b57b2be-7fd4-4544-90e5-c639a6acef46 req-44311938-b2bb-4533-9af4-7fd9629c4379 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8b57b2be-7fd4-4544-90e5-c639a6acef46 req-44311938-b2bb-4533-9af4-7fd9629c4379 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-8b57b2be-7fd4-4544-90e5-c639a6acef46 req-44311938-b2bb-4533-9af4-7fd9629c4379 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:31:06 user nova-compute[74534]: WARNING nova.compute.manager [req-8b57b2be-7fd4-4544-90e5-c639a6acef46 req-44311938-b2bb-4533-9af4-7fd9629c4379 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received unexpected event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 12:31:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:31:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-65e26b48-e744-4590-883a-2e8127c54b5a tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 34.489s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:31:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:31:18 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:31:18 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=24.913284301757812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:31:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:19 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:31:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:31:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:31:19 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:31:20 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:31:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:31:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:31:20 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:20 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:31:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:31:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:31:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:31:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Triggering sync for uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:31:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:31:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-changed-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Refreshing instance network info cache due to event network-changed-82174c92-9a75-4be9-b6b1-8e146aa46856. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:32:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] Acquiring lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] Acquired lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:15 user nova-compute[74534]: DEBUG nova.network.neutron [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Refreshing network info cache for port 82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG nova.network.neutron [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updated VIF entry in instance network info cache for port 82174c92-9a75-4be9-b6b1-8e146aa46856. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG nova.network.neutron [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updating instance_info_cache with network_info: [{"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7d1d922e-8a7b-461b-b00c-09ac8ef48a0e req-470567dc-283f-47f6-be47-c3394ea9c377 service nova] Releasing lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'flavor' on Instance uuid 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:17 user nova-compute[74534]: INFO nova.compute.manager [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Attaching volume 2293f5a1-f84c-45c1-b3c3-8ea2c5916fec to /dev/vdb
Nov 02 12:32:17 user nova-compute[74534]: DEBUG os_brick.utils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bda1b8-4753-425b-933e-6bda27a9f8e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9015487-192f-41f6-bde2-61c6ca4c6098]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaae5222-8f64-41e4-b84a-9aeffc2535b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0324a9-5718-4151-a208-5aec2436e6d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:32:17 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f630619-2916-412d-a9ad-32a2250b5a3c]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG os_brick.utils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updating existing volume attachment record: ea056b98-aac8-4991-9cd1-a31b8c1f2d04 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:32:18 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:32:18 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=24.901721954345703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:32:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing instance network info cache due to event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updated VIF entry in instance network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-498c0dfc-da36-48fd-9824-860400d4cf91 req-7efb8d6b-95c1-4385-b0da-09fb0d6464d8 service nova] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing instance network info cache due to event network-changed-00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] Acquiring lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] Acquired lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.network.neutron [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Refreshing network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:32:20 user nova-compute[74534]: INFO nova.compute.claims [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Claim successful on node user
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:20 user nova-compute[74534]: INFO nova.compute.manager [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Detaching volume 3be9142c-9245-41fd-afbf-2245b91133a5
Nov 02 12:32:20 user nova-compute[74534]: INFO nova.virt.block_device [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Attempting to driver detach volume 3be9142c-9245-41fd-afbf-2245b91133a5 from mountpoint /dev/vdb
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Attempting to detach device vdb from instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:32:20 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:20 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:32:20 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:32:20 user nova-compute[74534]:   <serial>3be9142c-9245-41fd-afbf-2245b91133a5</serial>
Nov 02 12:32:20 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:32:20 user nova-compute[74534]: </disk>
Nov 02 12:32:20 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:32:20 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully detached device vdb from instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 from the persistent domain config.
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:32:20 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:20 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:32:20 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:32:20 user nova-compute[74534]:   <serial>3be9142c-9245-41fd-afbf-2245b91133a5</serial>
Nov 02 12:32:20 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:32:20 user nova-compute[74534]: </disk>
Nov 02 12:32:20 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.network.neutron [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:32:20 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.network.neutron [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updated VIF entry in instance network info cache for port 00ac64e9-c6c7-4f1f-8288-75daf01fca5b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.network.neutron [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [{"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-344a264d-4343-49fd-8ba2-6004694d9614 req-febefadc-5665-41a0-85b3-1f71500197bc service nova] Releasing lock "refresh_cache-1e1b3a51-03ea-431a-b2fe-8227c4180832" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.policy [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd419025c7db34ae0bbce5f4ad1593b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1527fb853264bc98715200025614b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:32:20 user nova-compute[74534]: INFO nova.virt.block_device [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Booting with volume 0ebdf81f-8a95-467a-831b-58e8c87a9a79 at /dev/vda
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG os_brick.utils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2161544-a95e-4fa0-9d68-26ddfe84a6c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e40df4-6820-4e71-9cbc-43e2d17650d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d03a07f-fcfe-43e3-8208-c9118127635b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e686c8c9-a267-4327-8558-a32518fbe568]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:32:20 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:32:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeb9bda-7d0c-45ed-b8a3-1e696d274f3e]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG os_brick.utils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:32:20 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating existing volume attachment record: 4d4396ba-54fe-4974-8f29-f34249c3f808 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.network.neutron [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Successfully created port: e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.network.neutron [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Successfully updated port: e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.network.neutron [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:32:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing instance network info cache due to event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance network_info: |[{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:22 user nova-compute[74534]: INFO nova.compute.manager [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Detaching volume fc439c7f-eb15-4b66-844e-6cf8c6548d28
Nov 02 12:32:22 user nova-compute[74534]: INFO nova.virt.block_device [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Attempting to driver detach volume fc439c7f-eb15-4b66-844e-6cf8c6548d28 from mountpoint /dev/vdc
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Attempting to detach device vdc from instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:32:22 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:22 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:32:22 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:32:22 user nova-compute[74534]:   <serial>fc439c7f-eb15-4b66-844e-6cf8c6548d28</serial>
Nov 02 12:32:22 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:32:22 user nova-compute[74534]: </disk>
Nov 02 12:32:22 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:32:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully detached device vdc from instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 from the persistent domain config.
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:32:22 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:22 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:32:22 user nova-compute[74534]:   <target dev="vdc" bus="virtio"/>
Nov 02 12:32:22 user nova-compute[74534]:   <serial>fc439c7f-eb15-4b66-844e-6cf8c6548d28</serial>
Nov 02 12:32:22 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 12:32:22 user nova-compute[74534]: </disk>
Nov 02 12:32:22 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updated VIF entry in instance network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0db89b6e-0fad-4b66-aca5-79650e5c6391 req-04151fc7-8e5d-4d92-8087-929a4b853b97 service nova] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:32:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:26 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:32:27 user nova-compute[74534]: INFO nova.compute.claims [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Claim successful on node user
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:32:27 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:32:27 user nova-compute[74534]: DEBUG nova.policy [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28dcfc55e70c43b6ba92dfc1ea4c29ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60125df414f34e7a9cbe85b15fd1808e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:32:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Creating image(s)
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "/opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "/opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "/opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.207s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk 1073741824" returned: 0 in 0.052s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Successfully created port: 34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Cannot resize image /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Ensure instance console log exists: /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Successfully updated port: 34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquired lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-changed-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Refreshing instance network info cache due to event network-changed-34a4c6e9-20da-4556-b101-e1804fc44d5b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] Acquiring lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updating instance_info_cache with network_info: [{"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Releasing lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Instance network_info: |[{"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] Acquired lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.neutron [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Refreshing network info cache for port 34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Start _get_guest_xml network_info=[{"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:32:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:32:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1164136390',display_name='tempest-VolumesSnapshotTestJSON-instance-1164136390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1164136390',id=42,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI/z2hLGR8AYO9hT2Kl4rRhR/ye3ESqFNf3Jlzqs7bj/4G3G1PG9EhvHquI0cJGywt15rES3Fl70wT+h0oXIFyfQP0bANIz2t06GYTBEyIU90coxYR+1qzR4exRE06vHA==',key_name='tempest-keypair-450712764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60125df414f34e7a9cbe85b15fd1808e',ramdisk_id='',reservation_id='r-lbqm5yj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1611265569',owner_user_name='tempest-VolumesSnapshotTestJSON-1611265569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28dcfc55e70c43b6ba92dfc1ea4c29ce',uuid=90651628-ca5f-4ba6-be46-26d7a8feea6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converting VIF {"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:de,bridge_name='br-int',has_traffic_filtering=True,id=34a4c6e9-20da-4556-b101-e1804fc44d5b,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a4c6e9-20') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'pci_devices' on Instance uuid 90651628-ca5f-4ba6-be46-26d7a8feea6c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:32:29 user nova-compute[74534]:   <uuid>90651628-ca5f-4ba6-be46-26d7a8feea6c</uuid>
Nov 02 12:32:29 user nova-compute[74534]:   <name>instance-0000002a</name>
Nov 02 12:32:29 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:32:29 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:32:29 user nova-compute[74534]:   <metadata>
Nov 02 12:32:29 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:32:29 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:32:29 user nova-compute[74534]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1164136390</nova:name>
Nov 02 12:32:29 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:32:29</nova:creationTime>
Nov 02 12:32:29 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:32:29 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:32:29 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:32:29 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:32:29 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:32:29 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:32:29 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:32:29 user nova-compute[74534]:       <nova:owner>
Nov 02 12:32:29 user nova-compute[74534]:         <nova:user uuid="28dcfc55e70c43b6ba92dfc1ea4c29ce">tempest-VolumesSnapshotTestJSON-1611265569-project-member</nova:user>
Nov 02 12:32:29 user nova-compute[74534]:         <nova:project uuid="60125df414f34e7a9cbe85b15fd1808e">tempest-VolumesSnapshotTestJSON-1611265569</nova:project>
Nov 02 12:32:29 user nova-compute[74534]:       </nova:owner>
Nov 02 12:32:29 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:32:29 user nova-compute[74534]:       <nova:ports>
Nov 02 12:32:29 user nova-compute[74534]:         <nova:port uuid="34a4c6e9-20da-4556-b101-e1804fc44d5b">
Nov 02 12:32:29 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 12:32:29 user nova-compute[74534]:         </nova:port>
Nov 02 12:32:29 user nova-compute[74534]:       </nova:ports>
Nov 02 12:32:29 user nova-compute[74534]:     </nova:instance>
Nov 02 12:32:29 user nova-compute[74534]:   </metadata>
Nov 02 12:32:29 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:32:29 user nova-compute[74534]:     <system>
Nov 02 12:32:29 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:32:29 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:32:29 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:32:29 user nova-compute[74534]:       <entry name="serial">90651628-ca5f-4ba6-be46-26d7a8feea6c</entry>
Nov 02 12:32:29 user nova-compute[74534]:       <entry name="uuid">90651628-ca5f-4ba6-be46-26d7a8feea6c</entry>
Nov 02 12:32:29 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:32:29 user nova-compute[74534]:     </system>
Nov 02 12:32:29 user nova-compute[74534]:   </sysinfo>
Nov 02 12:32:29 user nova-compute[74534]:   <os>
Nov 02 12:32:29 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:32:29 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:32:29 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:32:29 user nova-compute[74534]:   </os>
Nov 02 12:32:29 user nova-compute[74534]:   <features>
Nov 02 12:32:29 user nova-compute[74534]:     <acpi/>
Nov 02 12:32:29 user nova-compute[74534]:     <apic/>
Nov 02 12:32:29 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:32:29 user nova-compute[74534]:   </features>
Nov 02 12:32:29 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:32:29 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:32:29 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:32:29 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:32:29 user nova-compute[74534]:   </clock>
Nov 02 12:32:29 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:32:29 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:32:29 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:32:29 user nova-compute[74534]:   </cpu>
Nov 02 12:32:29 user nova-compute[74534]:   <devices>
Nov 02 12:32:29 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:32:29 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:32:29 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk"/>
Nov 02 12:32:29 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:32:29 user nova-compute[74534]:     </disk>
Nov 02 12:32:29 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:32:29 user nova-compute[74534]:       <mac address="fa:16:3e:ad:1a:de"/>
Nov 02 12:32:29 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:32:29 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:32:29 user nova-compute[74534]:       <target dev="tap34a4c6e9-20"/>
Nov 02 12:32:29 user nova-compute[74534]:     </interface>
Nov 02 12:32:29 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:32:29 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/console.log" append="off"/>
Nov 02 12:32:29 user nova-compute[74534]:     </serial>
Nov 02 12:32:29 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:32:29 user nova-compute[74534]:     <video>
Nov 02 12:32:29 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:32:29 user nova-compute[74534]:     </video>
Nov 02 12:32:29 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:32:29 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:32:29 user nova-compute[74534]:     </rng>
Nov 02 12:32:29 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:32:29 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:32:29 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:32:29 user nova-compute[74534]:     </memballoon>
Nov 02 12:32:29 user nova-compute[74534]:   </devices>
Nov 02 12:32:29 user nova-compute[74534]: </domain>
Nov 02 12:32:29 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1164136390',display_name='tempest-VolumesSnapshotTestJSON-instance-1164136390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1164136390',id=42,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI/z2hLGR8AYO9hT2Kl4rRhR/ye3ESqFNf3Jlzqs7bj/4G3G1PG9EhvHquI0cJGywt15rES3Fl70wT+h0oXIFyfQP0bANIz2t06GYTBEyIU90coxYR+1qzR4exRE06vHA==',key_name='tempest-keypair-450712764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60125df414f34e7a9cbe85b15fd1808e',ramdisk_id='',reservation_id='r-lbqm5yj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1611265569',owner_user_name='tempest-VolumesSnapshotTestJSON-1611265569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28dcfc55e70c43b6ba92dfc1ea4c29ce',uuid=90651628-ca5f-4ba6-be46-26d7a8feea6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converting VIF {"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:de,bridge_name='br-int',has_traffic_filtering=True,id=34a4c6e9-20da-4556-b101-e1804fc44d5b,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a4c6e9-20') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG os_vif [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:de,bridge_name='br-int',has_traffic_filtering=True,id=34a4c6e9-20da-4556-b101-e1804fc44d5b,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a4c6e9-20') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f89a94a-f7a4-55db-86d2-1c2178fbb31e', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34a4c6e9-20, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34a4c6e9-20, col_values=(('qos', UUID('afb34677-a46e-4e93-881b-f88ea09ff63e')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34a4c6e9-20, col_values=(('external_ids', {'iface-id': '34a4c6e9-20da-4556-b101-e1804fc44d5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:1a:de', 'vm-uuid': '90651628-ca5f-4ba6-be46-26d7a8feea6c'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:29 user nova-compute[74534]: INFO os_vif [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:de,bridge_name='br-int',has_traffic_filtering=True,id=34a4c6e9-20da-4556-b101-e1804fc44d5b,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a4c6e9-20')
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:32:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No VIF found with MAC fa:16:3e:ad:1a:de, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:32:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:32:30 user nova-compute[74534]: DEBUG nova.network.neutron [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updated VIF entry in instance network info cache for port 34a4c6e9-20da-4556-b101-e1804fc44d5b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:32:30 user nova-compute[74534]: DEBUG nova.network.neutron [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updating instance_info_cache with network_info: [{"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:32:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d0d103ba-6720-4768-aadb-f2608b026aaa req-06be5821-b5d9-4d98-a6a3-ee3c02d7bfe8 service nova] Releasing lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-7e227d10-41d9-4fa9-9727-bfe90a0a8960 req-e85c2e1c-1813-4e5a-9f8b-d975b4c3dd3f service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7e227d10-41d9-4fa9-9727-bfe90a0a8960 req-e85c2e1c-1813-4e5a-9f8b-d975b4c3dd3f service nova] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7e227d10-41d9-4fa9-9727-bfe90a0a8960 req-e85c2e1c-1813-4e5a-9f8b-d975b4c3dd3f service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7e227d10-41d9-4fa9-9727-bfe90a0a8960 req-e85c2e1c-1813-4e5a-9f8b-d975b4c3dd3f service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-7e227d10-41d9-4fa9-9727-bfe90a0a8960 req-e85c2e1c-1813-4e5a-9f8b-d975b4c3dd3f service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] No waiting events found dispatching network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:32:31 user nova-compute[74534]: WARNING nova.compute.manager [req-7e227d10-41d9-4fa9-9727-bfe90a0a8960 req-e85c2e1c-1813-4e5a-9f8b-d975b4c3dd3f service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received unexpected event network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b for instance with vm_state building and task_state spawning.
Nov 02 12:32:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:32:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Instance spawned successfully.
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:33 user nova-compute[74534]: INFO nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-bd37f89f-1680-485e-9756-a58d83101f6f req-332f4503-ad5c-4d77-b0c1-e48055390ba8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd37f89f-1680-485e-9756-a58d83101f6f req-332f4503-ad5c-4d77-b0c1-e48055390ba8 service nova] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd37f89f-1680-485e-9756-a58d83101f6f req-332f4503-ad5c-4d77-b0c1-e48055390ba8 service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-bd37f89f-1680-485e-9756-a58d83101f6f req-332f4503-ad5c-4d77-b0c1-e48055390ba8 service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-bd37f89f-1680-485e-9756-a58d83101f6f req-332f4503-ad5c-4d77-b0c1-e48055390ba8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] No waiting events found dispatching network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:32:33 user nova-compute[74534]: WARNING nova.compute.manager [req-bd37f89f-1680-485e-9756-a58d83101f6f req-332f4503-ad5c-4d77-b0c1-e48055390ba8 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received unexpected event network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b for instance with vm_state building and task_state spawning.
Nov 02 12:32:33 user nova-compute[74534]: INFO nova.compute.manager [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Took 6.51 seconds to build instance.
Nov 02 12:32:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a84be6fd-982f-43eb-97ce-0caf699750f3 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.617s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAtlRcef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:32:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:32:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:32:39 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e280064-61c3-42d1-8cb4-a0bc90b85893]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:32:39 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a924105b-0d36-408a-8b3b-89782cb89630]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec] added
Nov 02 12:32:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a8f3fe-3b1b-4d6a-9597-44c6b199aa27]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[665fb207-8a8b-412c-9afd-962b943136ec]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAtlRcef {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAtlRcef" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a8454-2933-4487-bd8a-327d5f426a61]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XAtlRcef'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fadd7d-fc75-4697-9eb7-db625e898900]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[811e5bcf-4eb7-4e74-bcd8-913cb79271ee]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe562780-3409-4b0f-8d70-08b0c1fcd8fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260]
Nov 02 12:32:39 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260] successful.
Nov 02 12:32:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152008b-e329-4b21-b487-60a8f52288fd]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afce59f-ecb6-4c34-97dc-079d36570a02]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:39 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f432d-ffbf-4888-a426-56ab58db1f1d]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAtlRcef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:32:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23033306466346335', 'path': '/dev/sdd'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033306466346335', 'path': '/dev/sdd'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG nova.objects.instance [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'flavor' on Instance uuid 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:32:40 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:40 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:32:40 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:32:40 user nova-compute[74534]:   <serial>2293f5a1-f84c-45c1-b3c3-8ea2c5916fec</serial>
Nov 02 12:32:40 user nova-compute[74534]: </disk>
Nov 02 12:32:40 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:32:40 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 is timed out.
Nov 02 12:32:40 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully detached device vdb from instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 from the live domain config.
Nov 02 12:32:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kYIRaZbP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:32:40 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[980dfe99-a0df-4e3b-ad60-70033df66448]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:32:40 user nova-compute[74534]: No targets found.
Nov 02 12:32:40 user nova-compute[74534]: iSNS:
Nov 02 12:32:40 user nova-compute[74534]: No targets found.
Nov 02 12:32:40 user nova-compute[74534]: STATIC:
Nov 02 12:32:40 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec
Nov 02 12:32:40 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:32:40 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:32:40 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28
Nov 02 12:32:40 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:32:40 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:32:40 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5
Nov 02 12:32:40 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:32:40 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:32:40 user nova-compute[74534]: FIRMWARE:
Nov 02 12:32:40 user nova-compute[74534]: No targets found.
Nov 02 12:32:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:32:40 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:32:40 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcec626-11af-45d1-bb22-088eb01ea704]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c30efc-2e17-48a6-9b53-81843fe46d1d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:32:40 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:40 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 (non-flash)
Nov 02 12:32:40 user nova-compute[74534]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:40 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe19836dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd44ce-a822-4115-8dc1-7e945c4c1e3e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[47077a86-dbc1-4e30-95f7-64187e52fead]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c90fc34-fd3b-4a10-b528-fd30bee1f9c6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[954df9f9-d85e-44fe-af03-999d818aefd2]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0d0457-9e26-4cd9-97ce-a707682b73ee]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2b0fb1-7849-43fc-b4d7-15158c4e38a4]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260]
Nov 02 12:32:41 user nova-compute[74534]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5, portal: 172.16.0.220,3260] successful.
Nov 02 12:32:41 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9142c-9245-41fd-afbf-2245b91133a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fb496e-a5f5-491a-90c8-f8f073d00343]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== disconnect_volume: return (338ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] No VIF found with MAC fa:16:3e:46:fb:e7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:32:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-bc8a6486-f83c-4ec5-ba6b-4670d59beaee tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.090s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:32:42 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Creating image(s)
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Ensure instance console log exists: /opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Start _get_guest_xml network_info=[{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': '4d4396ba-54fe-4974-8f29-f34249c3f808', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e001e47a-a442-46c8-bd8f-9c559d6b2804', 'attached_at': '', 'detached_at': '', 'volume_id': '0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'serial': '0ebdf81f-8a95-467a-831b-58e8c87a9a79'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:32:42 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:32:42 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:32:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:32:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:32:42 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG nova.objects.instance [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'flavor' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e91c5-5a8c-4c0f-9823-cc5e0ea34d9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:32:42 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[83139fd6-a1f4-4489-bc46-1042cbe04413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79] added
Nov 02 12:32:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-86422317-3885-407a-9914-b5f5f15f6e1d tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.971s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[de29da3d-c113-4e78-a636-b283f4143474]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4550ef6-13ee-4d22-91ac-0e53eb1cf886]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLQFJdxh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLQFJdxh" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9869f9f-f4fd-4ba7-bc75-bd8c120179d7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CLQFJdxh'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[61181376-4183-49b0-9a3c-b0d8a5e3cea0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d5c530-54d8-45a4-aadf-7e45835c77e0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:42 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:42 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd3772-57b3-4e82-96d9-f50af11f33a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]
Nov 02 12:32:42 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.
Nov 02 12:32:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6bd68-7d49-4c35-b38d-d4269b68ca48]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee9b931-3fd0-449d-a8cd-f1e66a991b63]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:42 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:42 user nova-compute[74534]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:32:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:42 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:42 user nova-compute[74534]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:32:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dabab0a-fa15-4027-9721-50296e2c12c4]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:32:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:32:43 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 is timed out.
Nov 02 12:32:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully detached device vdc from instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 from the live domain config.
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RrqpXfoa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:32:43 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:43 user nova-compute[74534]: INFO nova.compute.manager [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Detaching volume 2293f5a1-f84c-45c1-b3c3-8ea2c5916fec
Nov 02 12:32:43 user nova-compute[74534]: INFO nova.virt.block_device [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Attempting to driver detach volume 2293f5a1-f84c-45c1-b3c3-8ea2c5916fec from mountpoint /dev/vdb
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Attempting to detach device vdb from instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:32:43 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:43 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:32:43 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:32:43 user nova-compute[74534]:   <serial>2293f5a1-f84c-45c1-b3c3-8ea2c5916fec</serial>
Nov 02 12:32:43 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:32:43 user nova-compute[74534]: </disk>
Nov 02 12:32:43 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:32:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully detached device vdb from instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 from the persistent domain config.
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:32:43 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:43 user nova-compute[74534]:   <source dev="/dev/sdd"/>
Nov 02 12:32:43 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:32:43 user nova-compute[74534]:   <serial>2293f5a1-f84c-45c1-b3c3-8ea2c5916fec</serial>
Nov 02 12:32:43 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:32:43 user nova-compute[74534]: </disk>
Nov 02 12:32:43 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23639326433633863', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639326433633863', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.346s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ca32d-7b8b-4646-8261-e896521c0147]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:32:43 user nova-compute[74534]: No targets found.
Nov 02 12:32:43 user nova-compute[74534]: iSNS:
Nov 02 12:32:43 user nova-compute[74534]: No targets found.
Nov 02 12:32:43 user nova-compute[74534]: STATIC:
Nov 02 12:32:43 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec
Nov 02 12:32:43 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:32:43 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:32:43 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79
Nov 02 12:32:43 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:32:43 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:32:43 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28
Nov 02 12:32:43 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:32:43 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:32:43 user nova-compute[74534]: FIRMWARE:
Nov 02 12:32:43 user nova-compute[74534]: No targets found.
Nov 02 12:32:43 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:32:43 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:32:43 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1763021455',display_name='tempest-TestShelveInstance-server-1763021455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1763021455',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkCgqkkBJZKzrsOKTvhhR7nKXvAZAo6vKsJvPlHFeKniBX9AayaCvO3DyNbHBVhUtHkKNWXfYketpZ5lUFWJtR4UsPfDcw2+zT8J4xARfu1iUlUeYJQY+CBcM97L8ndAA==',key_name='tempest-TestShelveInstance-1089529071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1527fb853264bc98715200025614b00',ramdisk_id='',reservation_id='r-gl5wpj2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-995727009',owner_user_name='tempest-TestShelveInstance-995727009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:32:21Z,user_data=None,user_id='d419025c7db34ae0bbce5f4ad1593b38',uuid=e001e47a-a442-46c8-bd8f-9c559d6b2804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converting VIF {"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.objects.instance [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'pci_devices' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb902cc8-58ba-450b-b5ee-fc311d6d2c2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:32:43 user nova-compute[74534]:   <uuid>e001e47a-a442-46c8-bd8f-9c559d6b2804</uuid>
Nov 02 12:32:43 user nova-compute[74534]:   <name>instance-00000029</name>
Nov 02 12:32:43 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:32:43 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:32:43 user nova-compute[74534]:   <metadata>
Nov 02 12:32:43 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:32:43 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:32:43 user nova-compute[74534]:       <nova:name>tempest-TestShelveInstance-server-1763021455</nova:name>
Nov 02 12:32:43 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:32:42</nova:creationTime>
Nov 02 12:32:43 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:32:43 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:32:43 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:32:43 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:32:43 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:32:43 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:32:43 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:32:43 user nova-compute[74534]:       <nova:owner>
Nov 02 12:32:43 user nova-compute[74534]:         <nova:user uuid="d419025c7db34ae0bbce5f4ad1593b38">tempest-TestShelveInstance-995727009-project-member</nova:user>
Nov 02 12:32:43 user nova-compute[74534]:         <nova:project uuid="f1527fb853264bc98715200025614b00">tempest-TestShelveInstance-995727009</nova:project>
Nov 02 12:32:43 user nova-compute[74534]:       </nova:owner>
Nov 02 12:32:43 user nova-compute[74534]:       <nova:ports>
Nov 02 12:32:43 user nova-compute[74534]:         <nova:port uuid="e6acc48f-32bc-471e-ad2b-95e716bd5ed7">
Nov 02 12:32:43 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:32:43 user nova-compute[74534]:         </nova:port>
Nov 02 12:32:43 user nova-compute[74534]:       </nova:ports>
Nov 02 12:32:43 user nova-compute[74534]:     </nova:instance>
Nov 02 12:32:43 user nova-compute[74534]:   </metadata>
Nov 02 12:32:43 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:32:43 user nova-compute[74534]:     <system>
Nov 02 12:32:43 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:32:43 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:32:43 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:32:43 user nova-compute[74534]:       <entry name="serial">e001e47a-a442-46c8-bd8f-9c559d6b2804</entry>
Nov 02 12:32:43 user nova-compute[74534]:       <entry name="uuid">e001e47a-a442-46c8-bd8f-9c559d6b2804</entry>
Nov 02 12:32:43 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:32:43 user nova-compute[74534]:     </system>
Nov 02 12:32:43 user nova-compute[74534]:   </sysinfo>
Nov 02 12:32:43 user nova-compute[74534]:   <os>
Nov 02 12:32:43 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:32:43 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:32:43 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:32:43 user nova-compute[74534]:   </os>
Nov 02 12:32:43 user nova-compute[74534]:   <features>
Nov 02 12:32:43 user nova-compute[74534]:     <acpi/>
Nov 02 12:32:43 user nova-compute[74534]:     <apic/>
Nov 02 12:32:43 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:32:43 user nova-compute[74534]:   </features>
Nov 02 12:32:43 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:32:43 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:32:43 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:32:43 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:32:43 user nova-compute[74534]:   </clock>
Nov 02 12:32:43 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:32:43 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:32:43 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:32:43 user nova-compute[74534]:   </cpu>
Nov 02 12:32:43 user nova-compute[74534]:   <devices>
Nov 02 12:32:43 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:32:43 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:32:43 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:32:43 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:32:43 user nova-compute[74534]:       <serial>0ebdf81f-8a95-467a-831b-58e8c87a9a79</serial>
Nov 02 12:32:43 user nova-compute[74534]:     </disk>
Nov 02 12:32:43 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:32:43 user nova-compute[74534]:       <mac address="fa:16:3e:7f:bb:ea"/>
Nov 02 12:32:43 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:32:43 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:32:43 user nova-compute[74534]:       <target dev="tape6acc48f-32"/>
Nov 02 12:32:43 user nova-compute[74534]:     </interface>
Nov 02 12:32:43 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:32:43 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804/console.log" append="off"/>
Nov 02 12:32:43 user nova-compute[74534]:     </serial>
Nov 02 12:32:43 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:32:43 user nova-compute[74534]:     <video>
Nov 02 12:32:43 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:32:43 user nova-compute[74534]:     </video>
Nov 02 12:32:43 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:32:43 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:32:43 user nova-compute[74534]:     </rng>
Nov 02 12:32:43 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:32:43 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:32:43 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:32:43 user nova-compute[74534]:     </memballoon>
Nov 02 12:32:43 user nova-compute[74534]:   </devices>
Nov 02 12:32:43 user nova-compute[74534]: </domain>
Nov 02 12:32:43 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1763021455',display_name='tempest-TestShelveInstance-server-1763021455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1763021455',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkCgqkkBJZKzrsOKTvhhR7nKXvAZAo6vKsJvPlHFeKniBX9AayaCvO3DyNbHBVhUtHkKNWXfYketpZ5lUFWJtR4UsPfDcw2+zT8J4xARfu1iUlUeYJQY+CBcM97L8ndAA==',key_name='tempest-TestShelveInstance-1089529071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1527fb853264bc98715200025614b00',ramdisk_id='',reservation_id='r-gl5wpj2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-995727009',owner_user_name='tempest-TestShelveInstance-995727009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:32:21Z,user_data=None,user_id='d419025c7db34ae0bbce5f4ad1593b38',uuid=e001e47a-a442-46c8-bd8f-9c559d6b2804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converting VIF {"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_vif [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98839f84-f93e-5f1b-a6b4-61e10b4a79f7', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6acc48f-32, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6acc48f-32, col_values=(('qos', UUID('9fe0d892-b31f-4ac7-900f-b7fa06cfa0a0')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6acc48f-32, col_values=(('external_ids', {'iface-id': 'e6acc48f-32bc-471e-ad2b-95e716bd5ed7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:bb:ea', 'vm-uuid': 'e001e47a-a442-46c8-bd8f-9c559d6b2804'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a8b41-a298-44b0-b65f-c01b08b63fba]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:43 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:43 user nova-compute[74534]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:32:43 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 (non-flash)
Nov 02 12:32:43 user nova-compute[74534]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:32:43 user nova-compute[74534]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:32:43 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c4bbac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:43 user nova-compute[74534]: INFO os_vif [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32')
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[99694e2d-3a06-442c-a22c-893b228c5aa7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.040s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2fe8a6-f469-4db0-9e42-3fefff6729e1]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[512829ee-5051-4173-bd8d-9aaae911df57]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] No VIF found with MAC fa:16:3e:7f:bb:ea, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d19cf5-83a9-457b-a74c-4bb30804fc35]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba16f11-1bb1-40de-815e-a36568cd6eee]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ef068-4949-4175-9355-92d8399c78f0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260]
Nov 02 12:32:43 user nova-compute[74534]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28, portal: 172.16.0.220,3260] successful.
Nov 02 12:32:43 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc439c7f-eb15-4b66-844e-6cf8c6548d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aeec09-d9e3-49f7-9564-a5b92fde9397]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] <== disconnect_volume: return (686ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:32:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:32:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:44 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'flavor' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:32:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ffeae551-67d6-47f8-96bc-254a7e2386d2 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.265s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-96ab1d2a-719f-465b-a5b2-6930909eab0a req-29fedb6e-0060-49b9-80d5-a25888ac47ff service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-96ab1d2a-719f-465b-a5b2-6930909eab0a req-29fedb6e-0060-49b9-80d5-a25888ac47ff service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-96ab1d2a-719f-465b-a5b2-6930909eab0a req-29fedb6e-0060-49b9-80d5-a25888ac47ff service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-96ab1d2a-719f-465b-a5b2-6930909eab0a req-29fedb6e-0060-49b9-80d5-a25888ac47ff service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG nova.compute.manager [req-96ab1d2a-719f-465b-a5b2-6930909eab0a req-29fedb6e-0060-49b9-80d5-a25888ac47ff service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:32:45 user nova-compute[74534]: WARNING nova.compute.manager [req-96ab1d2a-719f-465b-a5b2-6930909eab0a req-29fedb6e-0060-49b9-80d5-a25888ac47ff service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received unexpected event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with vm_state building and task_state spawning.
Nov 02 12:32:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:32:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance spawned successfully.
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-94986832-abc5-4a30-b42f-028f853ac162 req-3dc5304f-09fc-4bc5-b63d-ce644c4c269d service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94986832-abc5-4a30-b42f-028f853ac162 req-3dc5304f-09fc-4bc5-b63d-ce644c4c269d service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94986832-abc5-4a30-b42f-028f853ac162 req-3dc5304f-09fc-4bc5-b63d-ce644c4c269d service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94986832-abc5-4a30-b42f-028f853ac162 req-3dc5304f-09fc-4bc5-b63d-ce644c4c269d service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-94986832-abc5-4a30-b42f-028f853ac162 req-3dc5304f-09fc-4bc5-b63d-ce644c4c269d service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:32:47 user nova-compute[74534]: WARNING nova.compute.manager [req-94986832-abc5-4a30-b42f-028f853ac162 req-3dc5304f-09fc-4bc5-b63d-ce644c4c269d service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received unexpected event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with vm_state building and task_state spawning.
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:32:47 user nova-compute[74534]: INFO nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 02 12:32:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:32:47 user nova-compute[74534]: INFO nova.compute.manager [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Took 27.31 seconds to build instance.
Nov 02 12:32:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-265098d7-4346-4cba-897d-b398df544fac tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.436s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:32:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:32:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:03 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 is timed out.
Nov 02 12:33:03 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully detached device vdb from instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 from the live domain config.
Nov 02 12:33:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAtlRcef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:33:03 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30b955c-7afc-445d-9339-0bec94ce0ce6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:33:03 user nova-compute[74534]: No targets found.
Nov 02 12:33:03 user nova-compute[74534]: iSNS:
Nov 02 12:33:03 user nova-compute[74534]: No targets found.
Nov 02 12:33:03 user nova-compute[74534]: STATIC:
Nov 02 12:33:03 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec
Nov 02 12:33:03 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:33:03 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:33:03 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79
Nov 02 12:33:03 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:33:03 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:33:03 user nova-compute[74534]: FIRMWARE:
Nov 02 12:33:03 user nova-compute[74534]: No targets found.
Nov 02 12:33:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:33:03 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:33:03 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b859a2b9-d905-444d-895e-f9f6830fc10a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[902288e8-d243-4c6a-ac42-4942aec8fd03]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:33:03 user nova-compute[74534]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:33:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec (non-flash)
Nov 02 12:33:03 user nova-compute[74534]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:33:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c465510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec'): ({'sdd'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Removing single pathed devices sdd {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518f2b5-f91f-4808-a080-9a94e1b74a80]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c5e0c6-1bab-4fc3-9c77-8c1777619460]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Flushing IO for device /dev/sdd {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5644b36-f084-46b0-b1c6-12473f5600fb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e9e731-ef0d-4b00-8d73-905fb36e2d9a]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] SCSI volumes sdd have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964b04c-cd66-4b70-9b6e-ab75dffdd884]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[36092096-06db-4d34-9830-c90eb8585514]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260]
Nov 02 12:33:04 user nova-compute[74534]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec, portal: 172.16.0.220,3260] successful.
Nov 02 12:33:04 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2293f5a1-f84c-45c1-b3c3-8ea2c5916fec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f257c14e-99cd-4a2e-9f31-2b3a230c883f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] <== disconnect_volume: return (322ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:33:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:05 user nova-compute[74534]: DEBUG nova.objects.instance [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'flavor' on Instance uuid 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:33:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-85a1b830-de3f-46e3-8c25-29e873a74964 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.875s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:12 user nova-compute[74534]: INFO nova.compute.manager [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Terminating instance
Nov 02 12:33:12 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:33:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-141fb2ca-07c5-47a6-87fe-b9d05c4405d4 req-2e9cbe7e-2635-44d7-a868-cf3fe768e67a service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-unplugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-141fb2ca-07c5-47a6-87fe-b9d05c4405d4 req-2e9cbe7e-2635-44d7-a868-cf3fe768e67a service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-141fb2ca-07c5-47a6-87fe-b9d05c4405d4 req-2e9cbe7e-2635-44d7-a868-cf3fe768e67a service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-141fb2ca-07c5-47a6-87fe-b9d05c4405d4 req-2e9cbe7e-2635-44d7-a868-cf3fe768e67a service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-141fb2ca-07c5-47a6-87fe-b9d05c4405d4 req-2e9cbe7e-2635-44d7-a868-cf3fe768e67a service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-unplugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-141fb2ca-07c5-47a6-87fe-b9d05c4405d4 req-2e9cbe7e-2635-44d7-a868-cf3fe768e67a service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-unplugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Instance destroyed successfully.
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'resources' on Instance uuid f2b3c95b-d7a3-4be3-b8b5-19b46846cb80 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1937524847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1937524847',id=37,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPauEnbWfweb39Oo3xElef2YuDO9/Kav0uzfxMrQdf82nJM1FT1iXEOfKOiw9e/NOEvFkufTPaB4tsNEI+nZ4LzOpYNQiL3p/zoN3vxpUFMG1duq1lEVySHuV+ffwaneTA==',key_name='tempest-keypair-2048841498',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-xrnsj7em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=f2b3c95b-d7a3-4be3-b8b5-19b46846cb80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "address": "fa:16:3e:ed:f2:0d", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap937f85a3-c3", "ovs_interfaceid": "937f85a3-c324-4e8a-a72c-a81b10a9e8d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG os_vif [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap937f85a3-c3, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9b77998-8dc5-45cb-851b-e5cb896e4400) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:13 user nova-compute[74534]: INFO os_vif [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f2:0d,bridge_name='br-int',has_traffic_filtering=True,id=937f85a3-c324-4e8a-a72c-a81b10a9e8d3,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap937f85a3-c3')
Nov 02 12:33:13 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Deleting instance files /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80_del
Nov 02 12:33:13 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Deletion of /opt/stack/data/nova/instances/f2b3c95b-d7a3-4be3-b8b5-19b46846cb80_del complete
Nov 02 12:33:13 user nova-compute[74534]: INFO nova.compute.manager [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 12:33:13 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:33:13 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:33:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:14 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:33:14 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Took 0.77 seconds to deallocate network for instance.
Nov 02 12:33:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:14 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:33:14 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:33:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:14 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Deleted allocations for instance f2b3c95b-d7a3-4be3-b8b5-19b46846cb80
Nov 02 12:33:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d325a140-b0cd-4171-b96f-9db173ce4b6c tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-680fae12-254a-4aa9-8f73-27b8c2156fe7 req-2c3ff243-d1c5-4edf-9848-02da12a9e4f3 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680fae12-254a-4aa9-8f73-27b8c2156fe7 req-2c3ff243-d1c5-4edf-9848-02da12a9e4f3 service nova] Acquiring lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680fae12-254a-4aa9-8f73-27b8c2156fe7 req-2c3ff243-d1c5-4edf-9848-02da12a9e4f3 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-680fae12-254a-4aa9-8f73-27b8c2156fe7 req-2c3ff243-d1c5-4edf-9848-02da12a9e4f3 service nova] Lock "f2b3c95b-d7a3-4be3-b8b5-19b46846cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-680fae12-254a-4aa9-8f73-27b8c2156fe7 req-2c3ff243-d1c5-4edf-9848-02da12a9e4f3 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] No waiting events found dispatching network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:33:15 user nova-compute[74534]: WARNING nova.compute.manager [req-680fae12-254a-4aa9-8f73-27b8c2156fe7 req-2c3ff243-d1c5-4edf-9848-02da12a9e4f3 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received unexpected event network-vif-plugged-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 for instance with vm_state deleted and task_state None.
Nov 02 12:33:15 user nova-compute[74534]: DEBUG nova.compute.manager [req-680fae12-254a-4aa9-8f73-27b8c2156fe7 req-2c3ff243-d1c5-4edf-9848-02da12a9e4f3 service nova] [instance: f2b3c95b-d7a3-4be3-b8b5-19b46846cb80] Received event network-vif-deleted-937f85a3-c324-4e8a-a72c-a81b10a9e8d3 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:33:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:33:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:33:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8262MB free_disk=24.897979736328125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e001e47a-a442-46c8-bd8f-9c559d6b2804 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90651628-ca5f-4ba6-be46-26d7a8feea6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:33:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:21 user nova-compute[74534]: INFO nova.compute.manager [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Terminating instance
Nov 02 12:33:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-c1629da0-741e-44b9-9571-35ae0265cb7a req-0652ae37-dc44-4e29-bc22-9d012bfda896 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-unplugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c1629da0-741e-44b9-9571-35ae0265cb7a req-0652ae37-dc44-4e29-bc22-9d012bfda896 service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c1629da0-741e-44b9-9571-35ae0265cb7a req-0652ae37-dc44-4e29-bc22-9d012bfda896 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c1629da0-741e-44b9-9571-35ae0265cb7a req-0652ae37-dc44-4e29-bc22-9d012bfda896 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-c1629da0-741e-44b9-9571-35ae0265cb7a req-0652ae37-dc44-4e29-bc22-9d012bfda896 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-unplugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:33:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-c1629da0-741e-44b9-9571-35ae0265cb7a req-0652ae37-dc44-4e29-bc22-9d012bfda896 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-unplugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:33:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Instance destroyed successfully.
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.objects.instance [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'resources' on Instance uuid 1e1b3a51-03ea-431a-b2fe-8227c4180832 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-206304309',display_name='tempest-TestMinimumBasicScenario-server-206304309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-206304309',id=39,image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX+1vJdxfDhEoA+PYRIdI4ZHl4tNejUTJrRclUGhD/BKh07FxLguVTLoFVhqKuZ0rAPm9kdF6Jxb76pP4CEB6hfPDIG+3jkWPsyS38GhuC5KV8u5MSqFMQ49KoKVcgweA==',key_name='tempest-TestMinimumBasicScenario-2038886643',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-hfe32l35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acb5348a-8967-4a94-a78d-0047e3acbebd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:30:36Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1e1b3a51-03ea-431a-b2fe-8227c4180832,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "address": "fa:16:3e:06:1e:30", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ac64e9-c6", "ovs_interfaceid": "00ac64e9-c6c7-4f1f-8288-75daf01fca5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG os_vif [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00ac64e9-c6, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bba3a2d4-5894-4a6d-b710-f4698bed9648) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:22 user nova-compute[74534]: INFO os_vif [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:30,bridge_name='br-int',has_traffic_filtering=True,id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ac64e9-c6')
Nov 02 12:33:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Deleting instance files /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832_del
Nov 02 12:33:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Deletion of /opt/stack/data/nova/instances/1e1b3a51-03ea-431a-b2fe-8227c4180832_del complete
Nov 02 12:33:22 user nova-compute[74534]: INFO nova.compute.manager [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 02 12:33:22 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Skipping network cache update for instance because it is being deleted. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b6ea86be-2169-45d4-934f-27c8310deb55 req-b8da737a-b3f0-4e79-b2e7-88ba882839fa service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-deleted-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:22 user nova-compute[74534]: INFO nova.compute.manager [req-b6ea86be-2169-45d4-934f-27c8310deb55 req-b8da737a-b3f0-4e79-b2e7-88ba882839fa service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Neutron deleted interface 00ac64e9-c6c7-4f1f-8288-75daf01fca5b; detaching it from the instance and deleting it from the info cache
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-b6ea86be-2169-45d4-934f-27c8310deb55 req-b8da737a-b3f0-4e79-b2e7-88ba882839fa service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:33:22 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Took 0.57 seconds to deallocate network for instance.
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-b6ea86be-2169-45d4-934f-27c8310deb55 req-b8da737a-b3f0-4e79-b2e7-88ba882839fa service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Detach interface failed, port_id=00ac64e9-c6c7-4f1f-8288-75daf01fca5b, reason: Instance 1e1b3a51-03ea-431a-b2fe-8227c4180832 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:22 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updating instance_info_cache with network_info: [{"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:23 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Deleted allocations for instance 1e1b3a51-03ea-431a-b2fe-8227c4180832
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-adbda86a-a1bb-4a85-807d-8da5f3967182 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-3aa7c879-f0b5-4857-9937-628a34a50f51 req-a30d3fef-e072-4e80-9031-d6cc40464d95 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3aa7c879-f0b5-4857-9937-628a34a50f51 req-a30d3fef-e072-4e80-9031-d6cc40464d95 service nova] Acquiring lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3aa7c879-f0b5-4857-9937-628a34a50f51 req-a30d3fef-e072-4e80-9031-d6cc40464d95 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3aa7c879-f0b5-4857-9937-628a34a50f51 req-a30d3fef-e072-4e80-9031-d6cc40464d95 service nova] Lock "1e1b3a51-03ea-431a-b2fe-8227c4180832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-3aa7c879-f0b5-4857-9937-628a34a50f51 req-a30d3fef-e072-4e80-9031-d6cc40464d95 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] No waiting events found dispatching network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:33:23 user nova-compute[74534]: WARNING nova.compute.manager [req-3aa7c879-f0b5-4857-9937-628a34a50f51 req-a30d3fef-e072-4e80-9031-d6cc40464d95 service nova] [instance: 1e1b3a51-03ea-431a-b2fe-8227c4180832] Received unexpected event network-vif-plugged-00ac64e9-c6c7-4f1f-8288-75daf01fca5b for instance with vm_state deleted and task_state None.
Nov 02 12:33:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:28 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:33:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-changed-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:33 user nova-compute[74534]: DEBUG nova.compute.manager [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Refreshing instance network info cache due to event network-changed-82174c92-9a75-4be9-b6b1-8e146aa46856. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:33:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] Acquiring lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:33:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] Acquired lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:33:33 user nova-compute[74534]: DEBUG nova.network.neutron [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Refreshing network info cache for port 82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:34 user nova-compute[74534]: INFO nova.compute.manager [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Terminating instance
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.compute.manager [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.network.neutron [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updated VIF entry in instance network info cache for port 82174c92-9a75-4be9-b6b1-8e146aa46856. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.network.neutron [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updating instance_info_cache with network_info: [{"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-16303c83-1402-493c-b167-64111c29449d req-6e28c9d9-c94c-4237-8256-a8c59a4a43a1 service nova] Releasing lock "refresh_cache-0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-b248397b-7315-48bd-be45-5a8ed7f50ffe req-300b9e45-254f-4498-94bd-5c23bac0f3f7 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-vif-unplugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b248397b-7315-48bd-be45-5a8ed7f50ffe req-300b9e45-254f-4498-94bd-5c23bac0f3f7 service nova] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b248397b-7315-48bd-be45-5a8ed7f50ffe req-300b9e45-254f-4498-94bd-5c23bac0f3f7 service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b248397b-7315-48bd-be45-5a8ed7f50ffe req-300b9e45-254f-4498-94bd-5c23bac0f3f7 service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-b248397b-7315-48bd-be45-5a8ed7f50ffe req-300b9e45-254f-4498-94bd-5c23bac0f3f7 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] No waiting events found dispatching network-vif-unplugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.compute.manager [req-b248397b-7315-48bd-be45-5a8ed7f50ffe req-300b9e45-254f-4498-94bd-5c23bac0f3f7 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-vif-unplugged-82174c92-9a75-4be9-b6b1-8e146aa46856 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:33:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Instance destroyed successfully.
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'resources' on Instance uuid 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:30:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-548682608',display_name='tempest-TestStampPattern-server-548682608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-548682608',id=40,image_ref='66883a3a-bd33-4944-925f-1cc92235e36e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyesrse4Qmq0ljOTmJgUTPa80HlhGnznrWykxLsmeImeZmN0A/GNbPvkdqHaACktMD5zWY+kSTDiHn+TnqzzL/Kc+0idjnFHn3YoqoNxZu+ax4JBkG40G4iIxC7qKcBNA==',key_name='tempest-TestStampPattern-920487778',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069eff35ce894007921aee633a568ef7',ramdisk_id='',reservation_id='r-30h83697',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8f8b285e-6679-47f5-9467-ae6d788ea0f6',image_min_disk='1',image_min_ram='0',image_owner_id='069eff35ce894007921aee633a568ef7',image_owner_project_name='tempest-TestStampPattern-1394267046',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1394267046-project-member',image_user_id='e45f09340dc9451fbed7968edcfbe0ff',owner_project_name='tempest-TestStampPattern-1394267046',owner_user_name='tempest-TestStampPattern-1394267046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:30:32Z,user_data=None,user_id='e45f09340dc9451fbed7968edcfbe0ff',uuid=0a9fb1cc-b34b-4880-addd-481c5e9fa4a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converting VIF {"id": "82174c92-9a75-4be9-b6b1-8e146aa46856", "address": "fa:16:3e:46:fb:e7", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82174c92-9a", "ovs_interfaceid": "82174c92-9a75-4be9-b6b1-8e146aa46856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:fb:e7,bridge_name='br-int',has_traffic_filtering=True,id=82174c92-9a75-4be9-b6b1-8e146aa46856,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82174c92-9a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG os_vif [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:fb:e7,bridge_name='br-int',has_traffic_filtering=True,id=82174c92-9a75-4be9-b6b1-8e146aa46856,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82174c92-9a') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82174c92-9a, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cebdfc11-b8ad-4213-8848-1a27532cf36f) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:34 user nova-compute[74534]: INFO os_vif [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:fb:e7,bridge_name='br-int',has_traffic_filtering=True,id=82174c92-9a75-4be9-b6b1-8e146aa46856,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82174c92-9a')
Nov 02 12:33:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Deleting instance files /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0_del
Nov 02 12:33:34 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Deletion of /opt/stack/data/nova/instances/0a9fb1cc-b34b-4880-addd-481c5e9fa4a0_del complete
Nov 02 12:33:34 user nova-compute[74534]: INFO nova.compute.manager [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 02 12:33:34 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:33:34 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:33:35 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:33:35 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Took 0.43 seconds to deallocate network for instance.
Nov 02 12:33:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:35 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:33:35 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:33:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:35 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Deleted allocations for instance 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0
Nov 02 12:33:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-173e91a0-de7e-48c7-82ca-bd08c59dc483 tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.645s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-0114b5a8-7c95-4430-96b9-d705b2880697 req-a395246f-eb62-40ec-8b49-f52ba3e4cc77 service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-vif-deleted-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-6bf647b0-049d-4ff6-9c14-9112bc2b1a79 req-de086c47-9047-4e25-9c8c-cd90fc153fbc service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received event network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:33:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6bf647b0-049d-4ff6-9c14-9112bc2b1a79 req-de086c47-9047-4e25-9c8c-cd90fc153fbc service nova] Acquiring lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:33:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6bf647b0-049d-4ff6-9c14-9112bc2b1a79 req-de086c47-9047-4e25-9c8c-cd90fc153fbc service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:33:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6bf647b0-049d-4ff6-9c14-9112bc2b1a79 req-de086c47-9047-4e25-9c8c-cd90fc153fbc service nova] Lock "0a9fb1cc-b34b-4880-addd-481c5e9fa4a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:33:36 user nova-compute[74534]: DEBUG nova.compute.manager [req-6bf647b0-049d-4ff6-9c14-9112bc2b1a79 req-de086c47-9047-4e25-9c8c-cd90fc153fbc service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] No waiting events found dispatching network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:33:36 user nova-compute[74534]: WARNING nova.compute.manager [req-6bf647b0-049d-4ff6-9c14-9112bc2b1a79 req-de086c47-9047-4e25-9c8c-cd90fc153fbc service nova] [instance: 0a9fb1cc-b34b-4880-addd-481c5e9fa4a0] Received unexpected event network-vif-plugged-82174c92-9a75-4be9-b6b1-8e146aa46856 for instance with vm_state deleted and task_state None.
Nov 02 12:33:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:33:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:33:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:33:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:33:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:33:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:34:06 user nova-compute[74534]: INFO nova.compute.claims [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Claim successful on node user
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:34:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.policy [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6cc8a90d5468473dae411475ada29ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f367e2b6b094dbcb26fe289d0eda148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:34:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Creating image(s)
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.170s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk 1073741824" returned: 0 in 0.047s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Successfully created port: 6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Cannot resize image /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Ensure instance console log exists: /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Successfully updated port: 6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquired lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing instance network info cache due to event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] Acquiring lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Releasing lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance network_info: |[{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] Acquired lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Start _get_guest_xml network_info=[{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:34:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:34:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891563097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891563097',id=43,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Zs+NySjUoZG61Sjitv1zEk41zkTXJAiBelxKHhXIGPIdwV3hdKXZVBTQGGvIkgtF4YG4IV1tOR5KeXisENFHVR+KuMtf2quVDdJlpHwipOaGexV3j3IN+o6bPqSa2Fg==',key_name='tempest-keypair-1095099930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-fngaxt17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=e332c657-ebf8-4e04-8aaf-ba824ba18286,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.objects.instance [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'pci_devices' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:34:08 user nova-compute[74534]:   <uuid>e332c657-ebf8-4e04-8aaf-ba824ba18286</uuid>
Nov 02 12:34:08 user nova-compute[74534]:   <name>instance-0000002b</name>
Nov 02 12:34:08 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:34:08 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:34:08 user nova-compute[74534]:   <metadata>
Nov 02 12:34:08 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:34:08 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:34:08 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1891563097</nova:name>
Nov 02 12:34:08 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:34:08</nova:creationTime>
Nov 02 12:34:08 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:34:08 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:34:08 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:34:08 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:34:08 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:34:08 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:34:08 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:34:08 user nova-compute[74534]:       <nova:owner>
Nov 02 12:34:08 user nova-compute[74534]:         <nova:user uuid="6cc8a90d5468473dae411475ada29ba6">tempest-AttachVolumeShelveTestJSON-616827552-project-member</nova:user>
Nov 02 12:34:08 user nova-compute[74534]:         <nova:project uuid="2f367e2b6b094dbcb26fe289d0eda148">tempest-AttachVolumeShelveTestJSON-616827552</nova:project>
Nov 02 12:34:08 user nova-compute[74534]:       </nova:owner>
Nov 02 12:34:08 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:34:08 user nova-compute[74534]:       <nova:ports>
Nov 02 12:34:08 user nova-compute[74534]:         <nova:port uuid="6abce6fb-adf1-4961-84ea-2ecc2569845f">
Nov 02 12:34:08 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:34:08 user nova-compute[74534]:         </nova:port>
Nov 02 12:34:08 user nova-compute[74534]:       </nova:ports>
Nov 02 12:34:08 user nova-compute[74534]:     </nova:instance>
Nov 02 12:34:08 user nova-compute[74534]:   </metadata>
Nov 02 12:34:08 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:34:08 user nova-compute[74534]:     <system>
Nov 02 12:34:08 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:34:08 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:34:08 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:34:08 user nova-compute[74534]:       <entry name="serial">e332c657-ebf8-4e04-8aaf-ba824ba18286</entry>
Nov 02 12:34:08 user nova-compute[74534]:       <entry name="uuid">e332c657-ebf8-4e04-8aaf-ba824ba18286</entry>
Nov 02 12:34:08 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:34:08 user nova-compute[74534]:     </system>
Nov 02 12:34:08 user nova-compute[74534]:   </sysinfo>
Nov 02 12:34:08 user nova-compute[74534]:   <os>
Nov 02 12:34:08 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:34:08 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:34:08 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:34:08 user nova-compute[74534]:   </os>
Nov 02 12:34:08 user nova-compute[74534]:   <features>
Nov 02 12:34:08 user nova-compute[74534]:     <acpi/>
Nov 02 12:34:08 user nova-compute[74534]:     <apic/>
Nov 02 12:34:08 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:34:08 user nova-compute[74534]:   </features>
Nov 02 12:34:08 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:34:08 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:34:08 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:34:08 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:34:08 user nova-compute[74534]:   </clock>
Nov 02 12:34:08 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:34:08 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:34:08 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:34:08 user nova-compute[74534]:   </cpu>
Nov 02 12:34:08 user nova-compute[74534]:   <devices>
Nov 02 12:34:08 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:34:08 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:34:08 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk"/>
Nov 02 12:34:08 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:34:08 user nova-compute[74534]:     </disk>
Nov 02 12:34:08 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:34:08 user nova-compute[74534]:       <mac address="fa:16:3e:91:1c:ac"/>
Nov 02 12:34:08 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:34:08 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:34:08 user nova-compute[74534]:       <target dev="tap6abce6fb-ad"/>
Nov 02 12:34:08 user nova-compute[74534]:     </interface>
Nov 02 12:34:08 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:34:08 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/console.log" append="off"/>
Nov 02 12:34:08 user nova-compute[74534]:     </serial>
Nov 02 12:34:08 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:34:08 user nova-compute[74534]:     <video>
Nov 02 12:34:08 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:34:08 user nova-compute[74534]:     </video>
Nov 02 12:34:08 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:34:08 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:34:08 user nova-compute[74534]:     </rng>
Nov 02 12:34:08 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:34:08 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:34:08 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:34:08 user nova-compute[74534]:     </memballoon>
Nov 02 12:34:08 user nova-compute[74534]:   </devices>
Nov 02 12:34:08 user nova-compute[74534]: </domain>
Nov 02 12:34:08 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891563097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891563097',id=43,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Zs+NySjUoZG61Sjitv1zEk41zkTXJAiBelxKHhXIGPIdwV3hdKXZVBTQGGvIkgtF4YG4IV1tOR5KeXisENFHVR+KuMtf2quVDdJlpHwipOaGexV3j3IN+o6bPqSa2Fg==',key_name='tempest-keypair-1095099930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-fngaxt17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=e332c657-ebf8-4e04-8aaf-ba824ba18286,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG os_vif [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07ca67b5-965b-58cc-a2ef-4b3263b6c8a9', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6abce6fb-ad, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6abce6fb-ad, col_values=(('qos', UUID('98f4d817-9c08-4bb5-93c8-1bd1350d82f3')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6abce6fb-ad, col_values=(('external_ids', {'iface-id': '6abce6fb-adf1-4961-84ea-2ecc2569845f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:1c:ac', 'vm-uuid': 'e332c657-ebf8-4e04-8aaf-ba824ba18286'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:08 user nova-compute[74534]: INFO os_vif [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad')
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No VIF found with MAC fa:16:3e:91:1c:ac, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updated VIF entry in instance network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:34:08 user nova-compute[74534]: DEBUG nova.network.neutron [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e4c0a6ad-79fd-4191-b644-37f1f2d2abc1 req-f3114235-e965-4bfc-abe2-a820c6f2226b service nova] Releasing lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-233417b5-bc79-4f9d-ba6c-e957233b9548 req-0dcff0ad-ad8d-40e8-9e7a-b4474bbabbc4 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-233417b5-bc79-4f9d-ba6c-e957233b9548 req-0dcff0ad-ad8d-40e8-9e7a-b4474bbabbc4 service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-233417b5-bc79-4f9d-ba6c-e957233b9548 req-0dcff0ad-ad8d-40e8-9e7a-b4474bbabbc4 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-233417b5-bc79-4f9d-ba6c-e957233b9548 req-0dcff0ad-ad8d-40e8-9e7a-b4474bbabbc4 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-233417b5-bc79-4f9d-ba6c-e957233b9548 req-0dcff0ad-ad8d-40e8-9e7a-b4474bbabbc4 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:10 user nova-compute[74534]: WARNING nova.compute.manager [req-233417b5-bc79-4f9d-ba6c-e957233b9548 req-0dcff0ad-ad8d-40e8-9e7a-b4474bbabbc4 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received unexpected event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with vm_state building and task_state spawning.
Nov 02 12:34:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:11 user nova-compute[74534]: DEBUG nova.compute.manager [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing instance network info cache due to event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:34:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:11 user nova-compute[74534]: DEBUG nova.network.neutron [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updated VIF entry in instance network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:34:12 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance spawned successfully.
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-033272fa-4f2e-46f0-b56c-9e21d6045aaa req-3ef5a3c5-8859-4008-a212-8ba6e9aaf1ce service nova] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-8facd6e8-a407-4fc0-b3a4-0d2fff255785 req-7fcd651d-95be-4726-a36a-04aa4e1deb9b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8facd6e8-a407-4fc0-b3a4-0d2fff255785 req-7fcd651d-95be-4726-a36a-04aa4e1deb9b service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8facd6e8-a407-4fc0-b3a4-0d2fff255785 req-7fcd651d-95be-4726-a36a-04aa4e1deb9b service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8facd6e8-a407-4fc0-b3a4-0d2fff255785 req-7fcd651d-95be-4726-a36a-04aa4e1deb9b service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-8facd6e8-a407-4fc0-b3a4-0d2fff255785 req-7fcd651d-95be-4726-a36a-04aa4e1deb9b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:12 user nova-compute[74534]: WARNING nova.compute.manager [req-8facd6e8-a407-4fc0-b3a4-0d2fff255785 req-7fcd651d-95be-4726-a36a-04aa4e1deb9b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received unexpected event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with vm_state building and task_state spawning.
Nov 02 12:34:12 user nova-compute[74534]: INFO nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 02 12:34:12 user nova-compute[74534]: DEBUG nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:12 user nova-compute[74534]: INFO nova.compute.manager [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Shelve offloading
Nov 02 12:34:12 user nova-compute[74534]: INFO nova.compute.manager [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Took 6.32 seconds to build instance.
Nov 02 12:34:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-341dc889-b7f0-4e77-87db-74c152a14a30 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.421s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:13 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance destroyed successfully.
Nov 02 12:34:13 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:34:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:34:13 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance destroyed successfully.
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'resources' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1763021455',display_name='tempest-TestShelveInstance-server-1763021455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1763021455',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkCgqkkBJZKzrsOKTvhhR7nKXvAZAo6vKsJvPlHFeKniBX9AayaCvO3DyNbHBVhUtHkKNWXfYketpZ5lUFWJtR4UsPfDcw2+zT8J4xARfu1iUlUeYJQY+CBcM97L8ndAA==',key_name='tempest-TestShelveInstance-1089529071',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1527fb853264bc98715200025614b00',ramdisk_id='',reservation_id='r-gl5wpj2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-995727009',owner_user_name='tempest-TestShelveInstance-995727009-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:32:47Z,user_data=None,user_id='d419025c7db34ae0bbce5f4ad1593b38',uuid=e001e47a-a442-46c8-bd8f-9c559d6b2804,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converting VIF {"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_vif [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6acc48f-32, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing instance network info cache due to event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fe0d892-b31f-4ac7-900f-b7fa06cfa0a0) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:34:14 user nova-compute[74534]: INFO os_vif [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32')
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:34:14 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb2302-0d15-487a-b1b1-c75f76f83887]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:34:14 user nova-compute[74534]: No targets found.
Nov 02 12:34:14 user nova-compute[74534]: iSNS:
Nov 02 12:34:14 user nova-compute[74534]: No targets found.
Nov 02 12:34:14 user nova-compute[74534]: STATIC:
Nov 02 12:34:14 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79
Nov 02 12:34:14 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:34:14 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:34:14 user nova-compute[74534]: FIRMWARE:
Nov 02 12:34:14 user nova-compute[74534]: No targets found.
Nov 02 12:34:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:34:14 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:34:14 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[686dcc28-42fa-4a9e-af46-50f31b0a8ad9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a51c81-8b5e-4d6b-9c21-0923f2edd71f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:34:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:34:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c5b13f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-unplugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-unplugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:14 user nova-compute[74534]: WARNING nova.compute.manager [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received unexpected event network-vif-unplugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with vm_state active and task_state shelving.
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.compute.manager [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:14 user nova-compute[74534]: WARNING nova.compute.manager [req-de53680f-db44-43f5-b27c-1697a015d7d3 req-5414b7c9-07e7-4a0d-bccb-aa9bb5c4f4eb service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received unexpected event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with vm_state active and task_state shelving.
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf265060-a526-4f4c-9fce-5386cf2fa0c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1718446d-818c-4645-af53-b341c0d77250]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ffad0-3f20-4548-a579-4c909e17a310]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f36a9-92c9-41e5-9b44-8ff1b63db4fd]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b07acfb-08aa-4a54-af9e-071393caf729]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea6b24-3cb1-4e9d-8101-db125d2d7ec5]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]
Nov 02 12:34:14 user nova-compute[74534]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.
Nov 02 12:34:14 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6498bd-3f25-4520-aa4e-214eb301f8ea]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] <== disconnect_volume: return (296ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:34:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Deleting instance files /opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804_del
Nov 02 12:34:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Deletion of /opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804_del complete
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updated VIF entry in instance network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": null, "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape6acc48f-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a3265f88-bde6-4c0b-8967-9426e77a0aae req-ba78fdb7-d27f-4433-836b-90292aa7a09a service nova] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:34:15 user nova-compute[74534]: INFO nova.compute.claims [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Claim successful on node user
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:34:15 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Deleted allocations for instance e001e47a-a442-46c8-bd8f-9c559d6b2804
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'numa_topology' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.objects.base [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Object Instance<e001e47a-a442-46c8-bd8f-9c559d6b2804> lazy-loaded attributes: resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:34:15 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:34:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.policy [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dac1b3b4e45d42839c9a9413baa0fcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1851244b13ac4d26a5ffabc047210b4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:34:16 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Creating image(s)
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "/opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "/opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "/opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "a1622744d71e22c4c8a805f834c3b4c6b9895750" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "a1622744d71e22c4c8a805f834c3b4c6b9895750" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Successfully created port: 9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d509d9dc-de1d-4f61-be79-25f90a659dbb tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.359s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.part --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.virt.images [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] d40c5886-2bf0-4cf4-9143-599a7f37ef05 was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:34:16 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.part /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.part /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.converted" returned: 0 in 0.511s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Successfully updated port: 9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG nova.compute.manager [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing instance network info cache due to event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "a1622744d71e22c4c8a805f834c3b4c6b9895750" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.493s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750 --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "a1622744d71e22c4c8a805f834c3b4c6b9895750" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "a1622744d71e22c4c8a805f834c3b4c6b9895750" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750 --force-share --output=json" returned: 0 in 0.183s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750,backing_fmt=raw /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750,backing_fmt=raw /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk 1073741824" returned: 0 in 0.053s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "a1622744d71e22c4c8a805f834c3b4c6b9895750" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance network_info: |[{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750 --force-share --output=json" returned: 0 in 0.186s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-changed-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.compute.manager [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Refreshing instance network info cache due to event network-changed-34a4c6e9-20da-4556-b101-e1804fc44d5b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] Acquiring lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] Acquired lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Refreshing network info cache for port 34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Cannot resize image /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Ensure instance console log exists: /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Start _get_guest_xml network_info=[{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:34:13Z,direct_url=<?>,disk_format='qcow2',id=d40c5886-2bf0-4cf4-9143-599a7f37ef05,min_disk=0,min_ram=0,name='tempest-scenario-img--1888061504',owner='1851244b13ac4d26a5ffabc047210b4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:34:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'd40c5886-2bf0-4cf4-9143-599a7f37ef05'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:34:18 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:34:18 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:34:13Z,direct_url=<?>,disk_format='qcow2',id=d40c5886-2bf0-4cf4-9143-599a7f37ef05,min_disk=0,min_ram=0,name='tempest-scenario-img--1888061504',owner='1851244b13ac4d26a5ffabc047210b4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:34:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-73474126',display_name='tempest-TestMinimumBasicScenario-server-73474126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-73474126',id=44,image_ref='d40c5886-2bf0-4cf4-9143-599a7f37ef05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3lAgrwjVUE2S67OpYw1+/QyWj2ayIKdh+0S14gLI3D2JxCuv8k7+Zul5E7PALJNgLOJN21wAnhWlNuNgAvrJ7oT/SnLiB9nl5B1XGtufIubGJIQO10k3KzHMkwewD1tw==',key_name='tempest-TestMinimumBasicScenario-1457327264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-o8o3ulc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d40c5886-2bf0-4cf4-9143-599a7f37ef05',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:34:16Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1341c98f-8281-4722-8159-a85f8503c021,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:2b,bridge_name='br-int',has_traffic_filtering=True,id=9a05401b-26e3-4010-b2d6-36c034f222d5,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a05401b-26') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'pci_devices' on Instance uuid 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:34:18 user nova-compute[74534]:   <uuid>1341c98f-8281-4722-8159-a85f8503c021</uuid>
Nov 02 12:34:18 user nova-compute[74534]:   <name>instance-0000002c</name>
Nov 02 12:34:18 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:34:18 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:34:18 user nova-compute[74534]:   <metadata>
Nov 02 12:34:18 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:34:18 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:34:18 user nova-compute[74534]:       <nova:name>tempest-TestMinimumBasicScenario-server-73474126</nova:name>
Nov 02 12:34:18 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:34:18</nova:creationTime>
Nov 02 12:34:18 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:34:18 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:34:18 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:34:18 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:34:18 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:34:18 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:34:18 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:34:18 user nova-compute[74534]:       <nova:owner>
Nov 02 12:34:18 user nova-compute[74534]:         <nova:user uuid="dac1b3b4e45d42839c9a9413baa0fcec">tempest-TestMinimumBasicScenario-388517270-project-member</nova:user>
Nov 02 12:34:18 user nova-compute[74534]:         <nova:project uuid="1851244b13ac4d26a5ffabc047210b4d">tempest-TestMinimumBasicScenario-388517270</nova:project>
Nov 02 12:34:18 user nova-compute[74534]:       </nova:owner>
Nov 02 12:34:18 user nova-compute[74534]:       <nova:root type="image" uuid="d40c5886-2bf0-4cf4-9143-599a7f37ef05"/>
Nov 02 12:34:18 user nova-compute[74534]:       <nova:ports>
Nov 02 12:34:18 user nova-compute[74534]:         <nova:port uuid="9a05401b-26e3-4010-b2d6-36c034f222d5">
Nov 02 12:34:18 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 12:34:18 user nova-compute[74534]:         </nova:port>
Nov 02 12:34:18 user nova-compute[74534]:       </nova:ports>
Nov 02 12:34:18 user nova-compute[74534]:     </nova:instance>
Nov 02 12:34:18 user nova-compute[74534]:   </metadata>
Nov 02 12:34:18 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:34:18 user nova-compute[74534]:     <system>
Nov 02 12:34:18 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:34:18 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:34:18 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:34:18 user nova-compute[74534]:       <entry name="serial">1341c98f-8281-4722-8159-a85f8503c021</entry>
Nov 02 12:34:18 user nova-compute[74534]:       <entry name="uuid">1341c98f-8281-4722-8159-a85f8503c021</entry>
Nov 02 12:34:18 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:34:18 user nova-compute[74534]:     </system>
Nov 02 12:34:18 user nova-compute[74534]:   </sysinfo>
Nov 02 12:34:18 user nova-compute[74534]:   <os>
Nov 02 12:34:18 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:34:18 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:34:18 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:34:18 user nova-compute[74534]:   </os>
Nov 02 12:34:18 user nova-compute[74534]:   <features>
Nov 02 12:34:18 user nova-compute[74534]:     <acpi/>
Nov 02 12:34:18 user nova-compute[74534]:     <apic/>
Nov 02 12:34:18 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:34:18 user nova-compute[74534]:   </features>
Nov 02 12:34:18 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:34:18 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:34:18 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:34:18 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:34:18 user nova-compute[74534]:   </clock>
Nov 02 12:34:18 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:34:18 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:34:18 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:34:18 user nova-compute[74534]:   </cpu>
Nov 02 12:34:18 user nova-compute[74534]:   <devices>
Nov 02 12:34:18 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:34:18 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:34:18 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk"/>
Nov 02 12:34:18 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:34:18 user nova-compute[74534]:     </disk>
Nov 02 12:34:18 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:34:18 user nova-compute[74534]:       <mac address="fa:16:3e:26:93:2b"/>
Nov 02 12:34:18 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:34:18 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:34:18 user nova-compute[74534]:       <target dev="tap9a05401b-26"/>
Nov 02 12:34:18 user nova-compute[74534]:     </interface>
Nov 02 12:34:18 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:34:18 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/console.log" append="off"/>
Nov 02 12:34:18 user nova-compute[74534]:     </serial>
Nov 02 12:34:18 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:34:18 user nova-compute[74534]:     <video>
Nov 02 12:34:18 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:34:18 user nova-compute[74534]:     </video>
Nov 02 12:34:18 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:34:18 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:34:18 user nova-compute[74534]:     </rng>
Nov 02 12:34:18 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:34:18 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:34:18 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:34:18 user nova-compute[74534]:     </memballoon>
Nov 02 12:34:18 user nova-compute[74534]:   </devices>
Nov 02 12:34:18 user nova-compute[74534]: </domain>
Nov 02 12:34:18 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-73474126',display_name='tempest-TestMinimumBasicScenario-server-73474126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-73474126',id=44,image_ref='d40c5886-2bf0-4cf4-9143-599a7f37ef05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3lAgrwjVUE2S67OpYw1+/QyWj2ayIKdh+0S14gLI3D2JxCuv8k7+Zul5E7PALJNgLOJN21wAnhWlNuNgAvrJ7oT/SnLiB9nl5B1XGtufIubGJIQO10k3KzHMkwewD1tw==',key_name='tempest-TestMinimumBasicScenario-1457327264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-o8o3ulc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d40c5886-2bf0-4cf4-9143-599a7f37ef05',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:34:16Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1341c98f-8281-4722-8159-a85f8503c021,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:2b,bridge_name='br-int',has_traffic_filtering=True,id=9a05401b-26e3-4010-b2d6-36c034f222d5,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a05401b-26') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG os_vif [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:2b,bridge_name='br-int',has_traffic_filtering=True,id=9a05401b-26e3-4010-b2d6-36c034f222d5,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a05401b-26') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21d7f18d-f2bf-5d68-bd37-c562372e4100', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a05401b-26, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a05401b-26, col_values=(('qos', UUID('c1d63f62-b51a-4084-a0e6-d1676e771151')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a05401b-26, col_values=(('external_ids', {'iface-id': '9a05401b-26e3-4010-b2d6-36c034f222d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:93:2b', 'vm-uuid': '1341c98f-8281-4722-8159-a85f8503c021'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.objects.instance [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'flavor' on Instance uuid 90651628-ca5f-4ba6-be46-26d7a8feea6c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:18 user nova-compute[74534]: INFO os_vif [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:2b,bridge_name='br-int',has_traffic_filtering=True,id=9a05401b-26e3-4010-b2d6-36c034f222d5,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a05401b-26')
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated VIF entry in instance network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:18 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Ignoring supplied device name: /dev/vdb
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b20dd18c-ed8a-47fe-abff-fd21713c6db9 req-6676b9bb-fefa-422a-a594-0626fcfdb868 service nova] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No VIF found with MAC fa:16:3e:26:93:2b, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:18 user nova-compute[74534]: INFO nova.compute.manager [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Attaching volume 2d13da71-c3f0-45ad-945e-fd00235ec050 to /dev/vdb
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updated VIF entry in instance network info cache for port 34a4c6e9-20da-4556-b101-e1804fc44d5b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG nova.network.neutron [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updating instance_info_cache with network_info: [{"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-515744d6-5e3d-4d74-9648-6bd189500f2d req-38d389da-1f9b-4ac2-b5fd-7a3170a92bbb service nova] Releasing lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG os_brick.utils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[928be1ca-315c-43a6-a1e1-ed2b99dbc068]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f94edc-9ee0-4857-98da-0771b6f59491]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:18 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f79fd7-e381-4dbf-8de1-b20d9eed8eac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc8dcc-ee8a-485b-a35b-9f31088b0913]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:34:19 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcda713-c755-418c-98bb-7cb12bb990d9]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG os_brick.utils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updating existing volume attachment record: 1d4dc0db-1ddf-47db-90e0-e099e46be5ac {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:34:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:34:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8620MB free_disk=24.895587921142578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90651628-ca5f-4ba6-be46-26d7a8feea6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e332c657-ebf8-4e04-8aaf-ba824ba18286 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1341c98f-8281-4722-8159-a85f8503c021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-eb588090-1e90-4899-baa8-0213abad46c6 req-b8411450-e7ef-4f02-bcee-fb1aec32129f service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eb588090-1e90-4899-baa8-0213abad46c6 req-b8411450-e7ef-4f02-bcee-fb1aec32129f service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eb588090-1e90-4899-baa8-0213abad46c6 req-b8411450-e7ef-4f02-bcee-fb1aec32129f service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-eb588090-1e90-4899-baa8-0213abad46c6 req-b8411450-e7ef-4f02-bcee-fb1aec32129f service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.manager [req-eb588090-1e90-4899-baa8-0213abad46c6 req-b8411450-e7ef-4f02-bcee-fb1aec32129f service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:20 user nova-compute[74534]: WARNING nova.compute.manager [req-eb588090-1e90-4899-baa8-0213abad46c6 req-b8411450-e7ef-4f02-bcee-fb1aec32129f service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received unexpected event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with vm_state building and task_state spawning.
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:34:22 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance spawned successfully.
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:34:22 user nova-compute[74534]: INFO nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-f24d6916-d100-4246-a69d-3ed2096b251d req-1dc4405d-db65-4b28-aff8-7e8907945653 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f24d6916-d100-4246-a69d-3ed2096b251d req-1dc4405d-db65-4b28-aff8-7e8907945653 service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f24d6916-d100-4246-a69d-3ed2096b251d req-1dc4405d-db65-4b28-aff8-7e8907945653 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f24d6916-d100-4246-a69d-3ed2096b251d req-1dc4405d-db65-4b28-aff8-7e8907945653 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-f24d6916-d100-4246-a69d-3ed2096b251d req-1dc4405d-db65-4b28-aff8-7e8907945653 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:22 user nova-compute[74534]: WARNING nova.compute.manager [req-f24d6916-d100-4246-a69d-3ed2096b251d req-1dc4405d-db65-4b28-aff8-7e8907945653 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received unexpected event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with vm_state building and task_state spawning.
Nov 02 12:34:22 user nova-compute[74534]: INFO nova.compute.manager [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Took 6.88 seconds to build instance.
Nov 02 12:34:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ed15caea-501f-4910-a888-2a923270f72a tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:34:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnrhkcW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:34:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:34:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:34:39 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[467676ed-f786-459e-857b-c8da5a6bb7d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:34:39 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b5fe1-6b02-46d6-9844-9e971f39db8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050] added
Nov 02 12:34:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2e80f-16f7-456c-9935-08a2bd821e26]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4a980f-ebf5-4ca6-8415-b291b2dcfff4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPnrhkcW {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPnrhkcW" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[185091b1-289d-4fa9-b579-bac53664e3a0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPnrhkcW'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1fd89-4dcd-41ae-83e8-4d7002d09c7b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13e9723-9dd7-4f93-b06b-4aef9d6f08d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:34:39 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:34:39 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:34:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:34:39 user nova-compute[74534]: 
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c526d6-d4f5-42d3-830b-9bf470089644]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260]
Nov 02 12:34:39 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260] successful.
Nov 02 12:34:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[229abac0-1186-4ba1-a9ee-24a9c8373cb9]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9273efa9-1e87-49fb-a06e-47178c8ead80]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 (non-flash)
Nov 02 12:34:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 (non-flash)
Nov 02 12:34:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b46c4e-a0f0-4c8e-904f-54493825fb03]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:34:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnrhkcW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:34:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:34:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26163353966353137', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:34:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163353966353137', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:34:40 user nova-compute[74534]: DEBUG nova.objects.instance [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'flavor' on Instance uuid 90651628-ca5f-4ba6-be46-26d7a8feea6c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:34:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:34:40 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:34:40 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:34:40 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:34:40 user nova-compute[74534]:   <serial>2d13da71-c3f0-45ad-945e-fd00235ec050</serial>
Nov 02 12:34:40 user nova-compute[74534]: </disk>
Nov 02 12:34:40 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:34:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:34:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:34:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No VIF found with MAC fa:16:3e:ad:1a:de, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:34:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-88a223aa-4982-41f9-a4d6-68acd0a54d60 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.457s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-changed-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Refreshing instance network info cache due to event network-changed-25caa6e9-828b-4876-9be1-ab3cc1a643f2. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] Acquiring lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] Acquired lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG nova.network.neutron [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Refreshing network info cache for port 25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:46 user nova-compute[74534]: INFO nova.compute.manager [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Terminating instance
Nov 02 12:34:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-12f74c9c-551a-4772-a6ec-0a071ee8001b req-3ca21bde-2d64-4df0-a586-1cf6c67080a7 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-vif-unplugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-12f74c9c-551a-4772-a6ec-0a071ee8001b req-3ca21bde-2d64-4df0-a586-1cf6c67080a7 service nova] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-12f74c9c-551a-4772-a6ec-0a071ee8001b req-3ca21bde-2d64-4df0-a586-1cf6c67080a7 service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-12f74c9c-551a-4772-a6ec-0a071ee8001b req-3ca21bde-2d64-4df0-a586-1cf6c67080a7 service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-12f74c9c-551a-4772-a6ec-0a071ee8001b req-3ca21bde-2d64-4df0-a586-1cf6c67080a7 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] No waiting events found dispatching network-vif-unplugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-12f74c9c-551a-4772-a6ec-0a071ee8001b req-3ca21bde-2d64-4df0-a586-1cf6c67080a7 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-vif-unplugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.network.neutron [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updated VIF entry in instance network info cache for port 25caa6e9-828b-4876-9be1-ab3cc1a643f2. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.network.neutron [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [{"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b36f4249-5e67-4fc8-a1f4-fcd0535f3029 req-44aa9bf5-3c94-42b9-9c50-9bd37073f57b service nova] Releasing lock "refresh_cache-8f8b285e-6679-47f5-9467-ae6d788ea0f6" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Instance destroyed successfully.
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.objects.instance [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lazy-loading 'resources' on Instance uuid 8f8b285e-6679-47f5-9467-ae6d788ea0f6 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-144849544',display_name='tempest-TestStampPattern-server-144849544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-144849544',id=38,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyesrse4Qmq0ljOTmJgUTPa80HlhGnznrWykxLsmeImeZmN0A/GNbPvkdqHaACktMD5zWY+kSTDiHn+TnqzzL/Kc+0idjnFHn3YoqoNxZu+ax4JBkG40G4iIxC7qKcBNA==',key_name='tempest-TestStampPattern-920487778',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069eff35ce894007921aee633a568ef7',ramdisk_id='',reservation_id='r-a1ok94y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1394267046',owner_user_name='tempest-TestStampPattern-1394267046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:30:22Z,user_data=None,user_id='e45f09340dc9451fbed7968edcfbe0ff',uuid=8f8b285e-6679-47f5-9467-ae6d788ea0f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converting VIF {"id": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "address": "fa:16:3e:39:93:fc", "network": {"id": "83bc7439-7f64-4da5-886f-c0d645e05f85", "bridge": "br-int", "label": "tempest-TestStampPattern-99370830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069eff35ce894007921aee633a568ef7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25caa6e9-82", "ovs_interfaceid": "25caa6e9-828b-4876-9be1-ab3cc1a643f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:93:fc,bridge_name='br-int',has_traffic_filtering=True,id=25caa6e9-828b-4876-9be1-ab3cc1a643f2,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25caa6e9-82') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG os_vif [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:93:fc,bridge_name='br-int',has_traffic_filtering=True,id=25caa6e9-828b-4876-9be1-ab3cc1a643f2,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25caa6e9-82') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25caa6e9-82, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8a7fb02-d459-407f-bcec-b911d53b1953) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:47 user nova-compute[74534]: INFO os_vif [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:93:fc,bridge_name='br-int',has_traffic_filtering=True,id=25caa6e9-828b-4876-9be1-ab3cc1a643f2,network=Network(83bc7439-7f64-4da5-886f-c0d645e05f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25caa6e9-82')
Nov 02 12:34:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Deleting instance files /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6_del
Nov 02 12:34:47 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Deletion of /opt/stack/data/nova/instances/8f8b285e-6679-47f5-9467-ae6d788ea0f6_del complete
Nov 02 12:34:47 user nova-compute[74534]: INFO nova.compute.manager [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 02 12:34:47 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:34:47 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:34:48 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:34:48 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Took 0.94 seconds to deallocate network for instance.
Nov 02 12:34:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:49 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Deleted allocations for instance 8f8b285e-6679-47f5-9467-ae6d788ea0f6
Nov 02 12:34:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c02017a1-789b-4ef1-8b49-fef6e9677e5b tempest-TestStampPattern-1394267046 tempest-TestStampPattern-1394267046-project-member] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-e19f7d2d-e3d3-42e1-a69d-ecf630863093 req-3a986188-bbaf-4106-a769-7fa01b14d2c9 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e19f7d2d-e3d3-42e1-a69d-ecf630863093 req-3a986188-bbaf-4106-a769-7fa01b14d2c9 service nova] Acquiring lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e19f7d2d-e3d3-42e1-a69d-ecf630863093 req-3a986188-bbaf-4106-a769-7fa01b14d2c9 service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e19f7d2d-e3d3-42e1-a69d-ecf630863093 req-3a986188-bbaf-4106-a769-7fa01b14d2c9 service nova] Lock "8f8b285e-6679-47f5-9467-ae6d788ea0f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:34:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-e19f7d2d-e3d3-42e1-a69d-ecf630863093 req-3a986188-bbaf-4106-a769-7fa01b14d2c9 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] No waiting events found dispatching network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:34:49 user nova-compute[74534]: WARNING nova.compute.manager [req-e19f7d2d-e3d3-42e1-a69d-ecf630863093 req-3a986188-bbaf-4106-a769-7fa01b14d2c9 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received unexpected event network-vif-plugged-25caa6e9-828b-4876-9be1-ab3cc1a643f2 for instance with vm_state deleted and task_state None.
Nov 02 12:34:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-e19f7d2d-e3d3-42e1-a69d-ecf630863093 req-3a986188-bbaf-4106-a769-7fa01b14d2c9 service nova] [instance: 8f8b285e-6679-47f5-9467-ae6d788ea0f6] Received event network-vif-deleted-25caa6e9-828b-4876-9be1-ab3cc1a643f2 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:34:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:34:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:35:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:35:18 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:35:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:35:19 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:35:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=24.96310043334961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 90651628-ca5f-4ba6-be46-26d7a8feea6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e332c657-ebf8-4e04-8aaf-ba824ba18286 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1341c98f-8281-4722-8159-a85f8503c021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:35:19 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:35:20 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:35:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:35:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:35:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 90651628-ca5f-4ba6-be46-26d7a8feea6c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updating instance_info_cache with network_info: [{"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-90651628-ca5f-4ba6-be46-26d7a8feea6c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:35:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:35:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:35:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:35:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:35:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:35:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:35:45 user nova-compute[74534]: INFO nova.compute.manager [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Detaching volume 2d13da71-c3f0-45ad-945e-fd00235ec050
Nov 02 12:35:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:35:45 user nova-compute[74534]: INFO nova.virt.block_device [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Attempting to driver detach volume 2d13da71-c3f0-45ad-945e-fd00235ec050 from mountpoint /dev/vdb
Nov 02 12:35:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Attempting to detach device vdb from instance 90651628-ca5f-4ba6-be46-26d7a8feea6c from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:35:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:35:45 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:35:45 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:35:45 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:35:45 user nova-compute[74534]:   <serial>2d13da71-c3f0-45ad-945e-fd00235ec050</serial>
Nov 02 12:35:45 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:35:45 user nova-compute[74534]: </disk>
Nov 02 12:35:45 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:35:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully detached device vdb from instance 90651628-ca5f-4ba6-be46-26d7a8feea6c from the persistent domain config.
Nov 02 12:35:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90651628-ca5f-4ba6-be46-26d7a8feea6c from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:35:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:35:45 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:35:45 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:35:45 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:35:45 user nova-compute[74534]:   <serial>2d13da71-c3f0-45ad-945e-fd00235ec050</serial>
Nov 02 12:35:45 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:35:45 user nova-compute[74534]: </disk>
Nov 02 12:35:45 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:35:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90651628-ca5f-4ba6-be46-26d7a8feea6c {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:35:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:35:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing instance network info cache due to event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] Acquiring lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] Acquired lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updated VIF entry in instance network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-11b75adc-7b4e-45c8-b574-85a10ab691fc req-3014b4a2-1a0a-45ed-8fdb-fcc5ec01335b service nova] Releasing lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:35:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:35:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:04 user nova-compute[74534]: INFO nova.compute.manager [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Unshelving
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:04 user nova-compute[74534]: INFO nova.compute.manager [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Shelving
Nov 02 12:36:04 user nova-compute[74534]: INFO nova.virt.block_device [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Booting with volume 0ebdf81f-8a95-467a-831b-58e8c87a9a79 at /dev/vda
Nov 02 12:36:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG os_brick.utils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9efba58-f491-47ea-8943-4d0baec8343b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ceaf7e-785b-4d3e-86e4-bfd2514c5f29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b02d5-765f-4e5a-a764-64d325579301]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4c448e-bd58-42a7-b69b-ddc69a032994]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-b603f65a-f76e-416f-b32b-b26f1d9ec061 req-558634d3-f172-4568-9240-84c16b7a35fe service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-unplugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b603f65a-f76e-416f-b32b-b26f1d9ec061 req-558634d3-f172-4568-9240-84c16b7a35fe service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b603f65a-f76e-416f-b32b-b26f1d9ec061 req-558634d3-f172-4568-9240-84c16b7a35fe service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b603f65a-f76e-416f-b32b-b26f1d9ec061 req-558634d3-f172-4568-9240-84c16b7a35fe service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-b603f65a-f76e-416f-b32b-b26f1d9ec061 req-558634d3-f172-4568-9240-84c16b7a35fe service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-unplugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:04 user nova-compute[74534]: WARNING nova.compute.manager [req-b603f65a-f76e-416f-b32b-b26f1d9ec061 req-558634d3-f172-4568-9240-84c16b7a35fe service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received unexpected event network-vif-unplugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with vm_state active and task_state shelving.
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:36:04 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:36:04 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[adad31b2-96f4-4022-86d2-c57ecefb0109]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG os_brick.utils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating existing volume attachment record: fbd89e86-2862-4fb5-a92b-21dd911a84ca {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:36:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:04 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance destroyed successfully.
Nov 02 12:36:04 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Beginning cold snapshot process
Nov 02 12:36:05 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:36:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk /opt/stack/data/nova/instances/snapshots/tmp01072s_a/85d6ad9ecadc48888358eeb2d301ce62 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk /opt/stack/data/nova/instances/snapshots/tmp01072s_a/85d6ad9ecadc48888358eeb2d301ce62" returned: 0 in 0.570s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Snapshot extracted, beginning image upload
Nov 02 12:36:06 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 90651628-ca5f-4ba6-be46-26d7a8feea6c is timed out.
Nov 02 12:36:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully detached device vdb from instance 90651628-ca5f-4ba6-be46-26d7a8feea6c from the live domain config.
Nov 02 12:36:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnrhkcW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:36:06 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[57121393-1c81-4f1f-ba56-a05180404bd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:36:06 user nova-compute[74534]: No targets found.
Nov 02 12:36:06 user nova-compute[74534]: iSNS:
Nov 02 12:36:06 user nova-compute[74534]: No targets found.
Nov 02 12:36:06 user nova-compute[74534]: STATIC:
Nov 02 12:36:06 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050
Nov 02 12:36:06 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:36:06 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:36:06 user nova-compute[74534]: FIRMWARE:
Nov 02 12:36:06 user nova-compute[74534]: No targets found.
Nov 02 12:36:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:36:06 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:36:06 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f03aa-dfc7-4472-b91d-19618388536b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad33588-c2fb-42e6-968d-8efadaa0dabb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 (non-flash)
Nov 02 12:36:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 (non-flash)
Nov 02 12:36:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1804252d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[570fffdc-d358-4a9b-8b1e-e47f40aaa01d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a54c07-47d2-4902-8db4-ab697b10009a]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[972846ff-092c-47aa-9483-0753df36bd5c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db7831-d628-47d3-8358-84ae448f32c1]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-050164ca-e467-44b4-990f-0f611abf8c02 req-9bd6ceaa-963e-42f9-81f2-eac163a35fba service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-050164ca-e467-44b4-990f-0f611abf8c02 req-9bd6ceaa-963e-42f9-81f2-eac163a35fba service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-050164ca-e467-44b4-990f-0f611abf8c02 req-9bd6ceaa-963e-42f9-81f2-eac163a35fba service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-050164ca-e467-44b4-990f-0f611abf8c02 req-9bd6ceaa-963e-42f9-81f2-eac163a35fba service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-050164ca-e467-44b4-990f-0f611abf8c02 req-9bd6ceaa-963e-42f9-81f2-eac163a35fba service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:06 user nova-compute[74534]: WARNING nova.compute.manager [req-050164ca-e467-44b4-990f-0f611abf8c02 req-9bd6ceaa-963e-42f9-81f2-eac163a35fba service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received unexpected event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[920dd639-2be2-4319-9d95-3dd7e0a927e7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[348784d1-9403-46ed-a30f-7a5b616b5e3b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260]
Nov 02 12:36:06 user nova-compute[74534]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050, portal: 172.16.0.220,3260] successful.
Nov 02 12:36:06 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3093f5d1-67fd-44b8-9594-f07293ff05be]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== disconnect_volume: return (306ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:36:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG nova.objects.instance [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'flavor' on Instance uuid 90651628-ca5f-4ba6-be46-26d7a8feea6c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-591cba10-08a3-421a-a820-1fcc9f7a5fa4 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.870s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:07 user nova-compute[74534]: INFO nova.compute.manager [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Terminating instance
Nov 02 12:36:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Instance destroyed successfully.
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.objects.instance [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'resources' on Instance uuid 90651628-ca5f-4ba6-be46-26d7a8feea6c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1164136390',display_name='tempest-VolumesSnapshotTestJSON-instance-1164136390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1164136390',id=42,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI/z2hLGR8AYO9hT2Kl4rRhR/ye3ESqFNf3Jlzqs7bj/4G3G1PG9EhvHquI0cJGywt15rES3Fl70wT+h0oXIFyfQP0bANIz2t06GYTBEyIU90coxYR+1qzR4exRE06vHA==',key_name='tempest-keypair-450712764',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60125df414f34e7a9cbe85b15fd1808e',ramdisk_id='',reservation_id='r-lbqm5yj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1611265569',owner_user_name='tempest-VolumesSnapshotTestJSON-1611265569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28dcfc55e70c43b6ba92dfc1ea4c29ce',uuid=90651628-ca5f-4ba6-be46-26d7a8feea6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converting VIF {"id": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "address": "fa:16:3e:ad:1a:de", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34a4c6e9-20", "ovs_interfaceid": "34a4c6e9-20da-4556-b101-e1804fc44d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:1a:de,bridge_name='br-int',has_traffic_filtering=True,id=34a4c6e9-20da-4556-b101-e1804fc44d5b,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a4c6e9-20') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG os_vif [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:1a:de,bridge_name='br-int',has_traffic_filtering=True,id=34a4c6e9-20da-4556-b101-e1804fc44d5b,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a4c6e9-20') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34a4c6e9-20, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afb34677-a46e-4e93-881b-f88ea09ff63e) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:08 user nova-compute[74534]: INFO os_vif [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:1a:de,bridge_name='br-int',has_traffic_filtering=True,id=34a4c6e9-20da-4556-b101-e1804fc44d5b,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34a4c6e9-20')
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:2d13da71-c3f0-45ad-945e-fd00235ec050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPnrhkcW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:36:08 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:36:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[26d4b12a-d8ec-4a6c-a786-8cca85a688f3]: Unexpected error while running command.
Nov 02 12:36:08 user nova-compute[74534]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:36:08 user nova-compute[74534]: Exit code: 21
Nov 02 12:36:08 user nova-compute[74534]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:36:08 user nova-compute[74534]: Stderr: '' {{(pid=86346) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 02 12:36:08 user nova-compute[74534]: Traceback (most recent call last):
Nov 02 12:36:08 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 02 12:36:08 user nova-compute[74534]:     ret = func(*f_args, **f_kwargs)
Nov 02 12:36:08 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 02 12:36:08 user nova-compute[74534]:     return func(*args, **kwargs)
Nov 02 12:36:08 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 02 12:36:08 user nova-compute[74534]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 02 12:36:08 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 02 12:36:08 user nova-compute[74534]:     return putils.execute(on_execute=on_execute,
Nov 02 12:36:08 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 02 12:36:08 user nova-compute[74534]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 02 12:36:08 user nova-compute[74534]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 12:36:08 user nova-compute[74534]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:36:08 user nova-compute[74534]: Exit code: 21
Nov 02 12:36:08 user nova-compute[74534]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:36:08 user nova-compute[74534]: Stderr: ''
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d4b12a-d8ec-4a6c-a786-8cca85a688f3]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 12:36:08 user nova-compute[74534]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:36:08 user nova-compute[74534]: Exit code: 21
Nov 02 12:36:08 user nova-compute[74534]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:36:08 user nova-compute[74534]: Stderr: ''
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 02 12:36:08 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi 
Nov 02 12:36:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74534) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.033s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== disconnect_volume: return (34ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:36:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Deleting instance files /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c_del
Nov 02 12:36:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Deletion of /opt/stack/data/nova/instances/90651628-ca5f-4ba6-be46-26d7a8feea6c_del complete
Nov 02 12:36:08 user nova-compute[74534]: INFO nova.compute.manager [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:36:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Snapshot image upload complete
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-vif-unplugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] No waiting events found dispatching network-vif-unplugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-vif-unplugged-34a4c6e9-20da-4556-b101-e1804fc44d5b for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] Acquiring lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] No waiting events found dispatching network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:08 user nova-compute[74534]: WARNING nova.compute.manager [req-abe999f3-6e07-4a6b-ab66-1920290bc136 req-e997898b-42a9-43a2-ab45-cc729cdb15d7 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received unexpected event network-vif-plugged-34a4c6e9-20da-4556-b101-e1804fc44d5b for instance with vm_state active and task_state deleting.
Nov 02 12:36:08 user nova-compute[74534]: INFO nova.compute.manager [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Shelve offloading
Nov 02 12:36:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance destroyed successfully.
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquired lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.network.neutron [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Releasing lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:09 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Took 0.95 seconds to deallocate network for instance.
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.compute.manager [req-306763ae-2835-4b15-8884-6c29d1634411 req-2af16aec-ec0a-4c76-9b7b-52af1912ba56 service nova] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Received event network-vif-deleted-34a4c6e9-20da-4556-b101-e1804fc44d5b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:09 user nova-compute[74534]: WARNING nova.volume.cinder [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Attachment 1d4dc0db-1ddf-47db-90e0-e099e46be5ac does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1d4dc0db-1ddf-47db-90e0-e099e46be5ac. (HTTP 404) (Request-ID: req-c95a3096-a007-4c80-8805-b9fe2ce027f4)
Nov 02 12:36:09 user nova-compute[74534]: INFO nova.compute.manager [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: 90651628-ca5f-4ba6-be46-26d7a8feea6c] Took 0.03 seconds to detach 1 volumes for instance.
Nov 02 12:36:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:09 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Deleted allocations for instance 90651628-ca5f-4ba6-be46-26d7a8feea6c
Nov 02 12:36:09 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance destroyed successfully.
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'resources' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891563097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891563097',id=43,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Zs+NySjUoZG61Sjitv1zEk41zkTXJAiBelxKHhXIGPIdwV3hdKXZVBTQGGvIkgtF4YG4IV1tOR5KeXisENFHVR+KuMtf2quVDdJlpHwipOaGexV3j3IN+o6bPqSa2Fg==',key_name='tempest-keypair-1095099930',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-fngaxt17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member',shelved_at='2023-11-02T12:36:08.486561',shelved_host='user',shelved_image_id='91ccb259-cd80-4f96-ae47-4c55caa836fa'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:36:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=e332c657-ebf8-4e04-8aaf-ba824ba18286,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG os_vif [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6abce6fb-ad, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98f4d817-9c08-4bb5-93c8-1bd1350d82f3) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.compute.manager [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.compute.manager [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing instance network info cache due to event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] Acquiring lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] Acquired lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG nova.network.neutron [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:36:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:36:09 user nova-compute[74534]: INFO os_vif [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad')
Nov 02 12:36:09 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Deleting instance files /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286_del
Nov 02 12:36:09 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Deletion of /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286_del complete
Nov 02 12:36:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-6e4a6dab-3c6e-4629-9ef6-8bd86dcffff2 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "90651628-ca5f-4ba6-be46-26d7a8feea6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:09 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Deleted allocations for instance e332c657-ebf8-4e04-8aaf-ba824ba18286
Nov 02 12:36:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'numa_topology' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG nova.objects.base [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<e332c657-ebf8-4e04-8aaf-ba824ba18286> lazy-loaded attributes: resources,numa_topology {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3f6be862-6a97-49d3-8b56-6846fd9459c4 tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.187s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updated VIF entry in instance network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG nova.network.neutron [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6e6cf188-df6e-4ec0-8224-b4eb67971a35 req-77db202e-6b62-4e22-8c23-40fb31a7b448 service nova] Releasing lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:11 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:11 user nova-compute[74534]: DEBUG nova.objects.instance [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'flavor' on Instance uuid 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:12 user nova-compute[74534]: INFO nova.compute.manager [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Attaching volume 90338ef9-59ac-42ea-8bc2-1537062d5b5f to /dev/vdb
Nov 02 12:36:12 user nova-compute[74534]: DEBUG os_brick.utils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[21465c9f-45a3-4c76-aff9-319fbc380aa8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cec104-0e40-40e1-a6b6-1440c69e732e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e2d0fc-af0e-4757-944e-8e8924d60855]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d48cf60-41c9-4aac-b658-3c04e020076d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:36:12 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:36:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5237dbbe-5166-4a2d-b846-7ee5ced60021]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG os_brick.utils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:36:12 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating existing volume attachment record: 0c10e920-44c1-4492-a6af-a33b87e41afc {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:36:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:36:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:20 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:36:20 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=24.959896087646484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1341c98f-8281-4722-8159-a85f8503c021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e001e47a-a442-46c8-bd8f-9c559d6b2804 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:36:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:36:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'pci_requests' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'numa_topology' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:36:34 user nova-compute[74534]: INFO nova.compute.claims [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Claim successful on node user
Nov 02 12:36:34 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:36:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:34 user nova-compute[74534]: INFO nova.network.neutron [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating port e6acc48f-32bc-471e-ad2b-95e716bd5ed7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing instance network info cache due to event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:36:35 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Creating image(s)
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Ensure instance console log exists: /opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Start _get_guest_xml network_info=[{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'fbd89e86-2862-4fb5-a92b-21dd911a84ca', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e001e47a-a442-46c8-bd8f-9c559d6b2804', 'attached_at': '', 'detached_at': '', 'volume_id': '0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'serial': '0ebdf81f-8a95-467a-831b-58e8c87a9a79'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:36:35 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:36:35 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'vcpu_model' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.objects.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Object Instance<e001e47a-a442-46c8-bd8f-9c559d6b2804> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:36:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:36:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:36:35 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a6a686-db41-49c2-a075-21603a04a54b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:36:35 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[996a7658-9217-4511-9879-51649f6fa91a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79] added
Nov 02 12:36:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf5244-3025-42e4-b704-5a91e4e18d48]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dec1d4b-5d0e-4c88-8796-e6292e81f64e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLQFJdxh {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLQFJdxh" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb441bba-8a97-4955-a471-66528620c520]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CLQFJdxh'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d891d6a-2dc7-4b36-9636-9163511cf0f8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[911c75ca-db46-41d8-b294-b9dea25e29c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:36:35 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:36:35 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:36:35 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:36:35 user nova-compute[74534]: 
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d4bf4-ed5b-45c8-b007-a77ec2025780]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]
Nov 02 12:36:35 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.
Nov 02 12:36:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ca6242-5258-48e3-b6d5-e0bd1095e581]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d8cbc-ef8b-4ba8-99d1-4886974546f1]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:36:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:36:35 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb30b61-f5ec-4e46-beaf-536d4f438da1]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updated VIF entry in instance network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8fc78553-723b-4494-a150-347243600d92 req-f9b81322-5dcd-47bb-808d-066731b9ce33 service nova] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23639326433633863', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639326433633863', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1763021455',display_name='tempest-TestShelveInstance-server-1763021455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1763021455',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1089529071',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1527fb853264bc98715200025614b00',ramdisk_id='',reservation_id='r-gl5wpj2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-995727009',owner_user_name='tempest-TestShelveInstance-995727009-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:36:04Z,user_data=None,user_id='d419025c7db34ae0bbce5f4ad1593b38',uuid=e001e47a-a442-46c8-bd8f-9c559d6b2804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converting VIF {"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'pci_devices' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.objects.base [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Object Instance<e001e47a-a442-46c8-bd8f-9c559d6b2804> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:36:36 user nova-compute[74534]:   <uuid>e001e47a-a442-46c8-bd8f-9c559d6b2804</uuid>
Nov 02 12:36:36 user nova-compute[74534]:   <name>instance-00000029</name>
Nov 02 12:36:36 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:36:36 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:36:36 user nova-compute[74534]:   <metadata>
Nov 02 12:36:36 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:36:36 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:36:36 user nova-compute[74534]:       <nova:name>tempest-TestShelveInstance-server-1763021455</nova:name>
Nov 02 12:36:36 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:36:35</nova:creationTime>
Nov 02 12:36:36 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:36:36 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:36:36 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:36:36 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:36:36 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:36:36 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:36:36 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:36:36 user nova-compute[74534]:       <nova:owner>
Nov 02 12:36:36 user nova-compute[74534]:         <nova:user uuid="d419025c7db34ae0bbce5f4ad1593b38">tempest-TestShelveInstance-995727009-project-member</nova:user>
Nov 02 12:36:36 user nova-compute[74534]:         <nova:project uuid="f1527fb853264bc98715200025614b00">tempest-TestShelveInstance-995727009</nova:project>
Nov 02 12:36:36 user nova-compute[74534]:       </nova:owner>
Nov 02 12:36:36 user nova-compute[74534]:       <nova:ports>
Nov 02 12:36:36 user nova-compute[74534]:         <nova:port uuid="e6acc48f-32bc-471e-ad2b-95e716bd5ed7">
Nov 02 12:36:36 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 12:36:36 user nova-compute[74534]:         </nova:port>
Nov 02 12:36:36 user nova-compute[74534]:       </nova:ports>
Nov 02 12:36:36 user nova-compute[74534]:     </nova:instance>
Nov 02 12:36:36 user nova-compute[74534]:   </metadata>
Nov 02 12:36:36 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:36:36 user nova-compute[74534]:     <system>
Nov 02 12:36:36 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:36:36 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:36:36 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:36:36 user nova-compute[74534]:       <entry name="serial">e001e47a-a442-46c8-bd8f-9c559d6b2804</entry>
Nov 02 12:36:36 user nova-compute[74534]:       <entry name="uuid">e001e47a-a442-46c8-bd8f-9c559d6b2804</entry>
Nov 02 12:36:36 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:36:36 user nova-compute[74534]:     </system>
Nov 02 12:36:36 user nova-compute[74534]:   </sysinfo>
Nov 02 12:36:36 user nova-compute[74534]:   <os>
Nov 02 12:36:36 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:36:36 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:36:36 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:36:36 user nova-compute[74534]:   </os>
Nov 02 12:36:36 user nova-compute[74534]:   <features>
Nov 02 12:36:36 user nova-compute[74534]:     <acpi/>
Nov 02 12:36:36 user nova-compute[74534]:     <apic/>
Nov 02 12:36:36 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:36:36 user nova-compute[74534]:   </features>
Nov 02 12:36:36 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:36:36 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:36:36 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:36:36 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:36:36 user nova-compute[74534]:   </clock>
Nov 02 12:36:36 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:36:36 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:36:36 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:36:36 user nova-compute[74534]:   </cpu>
Nov 02 12:36:36 user nova-compute[74534]:   <devices>
Nov 02 12:36:36 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:36:36 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:36:36 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:36:36 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:36:36 user nova-compute[74534]:       <serial>0ebdf81f-8a95-467a-831b-58e8c87a9a79</serial>
Nov 02 12:36:36 user nova-compute[74534]:     </disk>
Nov 02 12:36:36 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:36:36 user nova-compute[74534]:       <mac address="fa:16:3e:7f:bb:ea"/>
Nov 02 12:36:36 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:36:36 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:36:36 user nova-compute[74534]:       <target dev="tape6acc48f-32"/>
Nov 02 12:36:36 user nova-compute[74534]:     </interface>
Nov 02 12:36:36 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:36:36 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804/console.log" append="off"/>
Nov 02 12:36:36 user nova-compute[74534]:     </serial>
Nov 02 12:36:36 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:36:36 user nova-compute[74534]:     <video>
Nov 02 12:36:36 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:36:36 user nova-compute[74534]:     </video>
Nov 02 12:36:36 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:36:36 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:36:36 user nova-compute[74534]:     </rng>
Nov 02 12:36:36 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:36:36 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:36:36 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:36:36 user nova-compute[74534]:     </memballoon>
Nov 02 12:36:36 user nova-compute[74534]:   </devices>
Nov 02 12:36:36 user nova-compute[74534]: </domain>
Nov 02 12:36:36 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1763021455',display_name='tempest-TestShelveInstance-server-1763021455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1763021455',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1089529071',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1527fb853264bc98715200025614b00',ramdisk_id='',reservation_id='r-gl5wpj2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-995727009',owner_user_name='tempest-TestShelveInstance-995727009-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:36:04Z,user_data=None,user_id='d419025c7db34ae0bbce5f4ad1593b38',uuid=e001e47a-a442-46c8-bd8f-9c559d6b2804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converting VIF {"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG os_vif [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98839f84-f93e-5f1b-a6b4-61e10b4a79f7', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6acc48f-32, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6acc48f-32, col_values=(('qos', UUID('c665bdc2-310f-4ac5-867a-f3fcda82f825')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6acc48f-32, col_values=(('external_ids', {'iface-id': 'e6acc48f-32bc-471e-ad2b-95e716bd5ed7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:bb:ea', 'vm-uuid': 'e001e47a-a442-46c8-bd8f-9c559d6b2804'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:36:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:36 user nova-compute[74534]: INFO os_vif [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32')
Nov 02 12:36:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:36:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] No VIF found with MAC fa:16:3e:7f:bb:ea, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-d64013c3-d51e-4652-b404-f886a86f9844 req-fc5cd9df-835f-4ab5-8276-e9017d8cdf15 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d64013c3-d51e-4652-b404-f886a86f9844 req-fc5cd9df-835f-4ab5-8276-e9017d8cdf15 service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d64013c3-d51e-4652-b404-f886a86f9844 req-fc5cd9df-835f-4ab5-8276-e9017d8cdf15 service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d64013c3-d51e-4652-b404-f886a86f9844 req-fc5cd9df-835f-4ab5-8276-e9017d8cdf15 service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-d64013c3-d51e-4652-b404-f886a86f9844 req-fc5cd9df-835f-4ab5-8276-e9017d8cdf15 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:38 user nova-compute[74534]: WARNING nova.compute.manager [req-d64013c3-d51e-4652-b404-f886a86f9844 req-fc5cd9df-835f-4ab5-8276-e9017d8cdf15 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received unexpected event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 12:36:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:36:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:36:40 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance spawned successfully.
Nov 02 12:36:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:36:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-c5f41802-4ec4-4e73-a57c-bb9ab66b9401 req-63dc6905-f071-4e48-bfb5-91910a79056a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c5f41802-4ec4-4e73-a57c-bb9ab66b9401 req-63dc6905-f071-4e48-bfb5-91910a79056a service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c5f41802-4ec4-4e73-a57c-bb9ab66b9401 req-63dc6905-f071-4e48-bfb5-91910a79056a service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-c5f41802-4ec4-4e73-a57c-bb9ab66b9401 req-63dc6905-f071-4e48-bfb5-91910a79056a service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:40 user nova-compute[74534]: DEBUG nova.compute.manager [req-c5f41802-4ec4-4e73-a57c-bb9ab66b9401 req-63dc6905-f071-4e48-bfb5-91910a79056a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:40 user nova-compute[74534]: WARNING nova.compute.manager [req-c5f41802-4ec4-4e73-a57c-bb9ab66b9401 req-63dc6905-f071-4e48-bfb5-91910a79056a service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received unexpected event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 12:36:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a76561c4-794b-4566-8053-1297e32a4f70 tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 36.513s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPScADCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:36:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:36:42 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:36:42 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5733159-03aa-45f3-8075-60a24ced224d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:36:42 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbcd578-2e16-4723-b9f1-52017ee1f183]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f] added
Nov 02 12:36:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[014ad4b3-fe9e-4239-a765-6b5fb2e1628e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbbe8df-c5db-4868-b862-53f8b77e6e29]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rPScADCe {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rPScADCe" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd0ac4-7976-4170-a713-22091e0b039f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rPScADCe'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[761b0225-4ce2-4018-a714-e308b24e08bb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ea09c-6d7a-4539-8580-e9248677eb85]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:36:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:36:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e841c6-739a-4597-975f-23e75af6421a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260]
Nov 02 12:36:42 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260] successful.
Nov 02 12:36:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[300bf74e-b315-4238-8cd0-8df8ec8cab0f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9fa8da-ba2e-4671-ba3d-b2fd21adc3c3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:36:42 user nova-compute[74534]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)
Nov 02 12:36:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:36:42 user nova-compute[74534]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)
Nov 02 12:36:42 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:36:42 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:36:43 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:36:43 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd2b86-0bf3-4490-8d5f-70ed3369487d]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:36:43 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:36:43 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPScADCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23233666661306564', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233666661306564', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG nova.objects.instance [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'flavor' on Instance uuid 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:36:44 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:36:44 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:36:44 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:36:44 user nova-compute[74534]:   <serial>90338ef9-59ac-42ea-8bc2-1537062d5b5f</serial>
Nov 02 12:36:44 user nova-compute[74534]: </disk>
Nov 02 12:36:44 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] No VIF found with MAC fa:16:3e:26:93:2b, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:36:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-44a043f1-9e4f-4cad-8a35-80e3717e8482 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.588s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing instance network info cache due to event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:36:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:47 user nova-compute[74534]: DEBUG nova.network.neutron [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:36:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated VIF entry in instance network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:36:48 user nova-compute[74534]: DEBUG nova.network.neutron [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4771f4cd-ec1f-40e1-b7be-4e278726ba10 req-61f1887e-c2b6-4d4f-bf5d-263285687075 service nova] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing instance network info cache due to event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:36:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:49 user nova-compute[74534]: DEBUG nova.network.neutron [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:36:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated VIF entry in instance network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:36:50 user nova-compute[74534]: DEBUG nova.network.neutron [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5ad34469-fdfc-43f2-a9f3-df0c8a713e0a req-028de959-7cbb-4e00-9a52-9ae14a7d5126 service nova] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:50 user nova-compute[74534]: INFO nova.compute.manager [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Rebooting instance
Nov 02 12:36:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:36:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:36:50 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:36:51 user nova-compute[74534]: DEBUG nova.network.neutron [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:36:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:36:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:36:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-740b684c-574b-4302-9cec-706af57bfe38 req-cf2643a8-74db-4393-9602-c0fa03781025 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-unplugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-740b684c-574b-4302-9cec-706af57bfe38 req-cf2643a8-74db-4393-9602-c0fa03781025 service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-740b684c-574b-4302-9cec-706af57bfe38 req-cf2643a8-74db-4393-9602-c0fa03781025 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-740b684c-574b-4302-9cec-706af57bfe38 req-cf2643a8-74db-4393-9602-c0fa03781025 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-740b684c-574b-4302-9cec-706af57bfe38 req-cf2643a8-74db-4393-9602-c0fa03781025 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-unplugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:54 user nova-compute[74534]: WARNING nova.compute.manager [req-740b684c-574b-4302-9cec-706af57bfe38 req-cf2643a8-74db-4393-9602-c0fa03781025 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received unexpected event network-vif-unplugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with vm_state active and task_state reboot_started.
Nov 02 12:36:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance shutdown successfully.
Nov 02 12:36:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:56 user nova-compute[74534]: WARNING nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received unexpected event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with vm_state active and task_state reboot_started.
Nov 02 12:36:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:56 user nova-compute[74534]: WARNING nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received unexpected event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with vm_state active and task_state reboot_started.
Nov 02 12:36:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:36:56 user nova-compute[74534]: WARNING nova.compute.manager [req-4ed93ef6-be1b-4255-9665-0b2aa441b133 req-f59c377c-29db-4327-8086-a7d22a8cc436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received unexpected event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with vm_state active and task_state reboot_started.
Nov 02 12:36:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:36:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance running successfully.
Nov 02 12:36:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance soft rebooted successfully.
Nov 02 12:36:57 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:36:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ef3fde7d-5b7b-4a3c-b15b-d468bb15f7f3 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.386s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:36:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:37:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:37:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:22 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:37:22 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=24.956375122070312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1341c98f-8281-4722-8159-a85f8503c021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e001e47a-a442-46c8-bd8f-9c559d6b2804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:37:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:37:23 user nova-compute[74534]: INFO nova.compute.claims [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Claim successful on node user
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:37:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.policy [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28dcfc55e70c43b6ba92dfc1ea4c29ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60125df414f34e7a9cbe85b15fd1808e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:37:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Creating image(s)
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "/opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "/opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "/opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.190s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk 1073741824" returned: 0 in 0.048s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.235s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Successfully created port: 29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Cannot resize image /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Ensure instance console log exists: /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Successfully updated port: 29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquired lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-changed-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Refreshing instance network info cache due to event network-changed-29cd8641-8c80-4794-a334-14fe4fe1ea22. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] Acquiring lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updating instance_info_cache with network_info: [{"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Releasing lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Instance network_info: |[{"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] Acquired lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.neutron [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Refreshing network info cache for port 29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Start _get_guest_xml network_info=[{"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:37:25 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:37:25 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1530462440',display_name='tempest-VolumesSnapshotTestJSON-instance-1530462440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1530462440',id=45,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdml6A5QV6qyjHIZkeGE2LWJAwajLglv5+6jQ7noWfdroZW0xmcHbt9Y5fFoPmgsuAmce/UWZkYfTg7suDEjmcWU3jYl4m54ZhDWzRa08d4HQL2tzBQquEwnlQX9hN/bw==',key_name='tempest-keypair-1746948359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60125df414f34e7a9cbe85b15fd1808e',ramdisk_id='',reservation_id='r-4utcf7va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1611265569',owner_user_name='tempest-VolumesSnapshotTestJSON-1611265569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28dcfc55e70c43b6ba92dfc1ea4c29ce',uuid=c065f4c9-250c-4cac-817f-4ed7ea9b6ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converting VIF {"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=29cd8641-8c80-4794-a334-14fe4fe1ea22,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29cd8641-8c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.objects.instance [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'pci_devices' on Instance uuid c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:37:25 user nova-compute[74534]:   <uuid>c065f4c9-250c-4cac-817f-4ed7ea9b6ca9</uuid>
Nov 02 12:37:25 user nova-compute[74534]:   <name>instance-0000002d</name>
Nov 02 12:37:25 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:37:25 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:37:25 user nova-compute[74534]:   <metadata>
Nov 02 12:37:25 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:37:25 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:37:25 user nova-compute[74534]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1530462440</nova:name>
Nov 02 12:37:25 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:37:25</nova:creationTime>
Nov 02 12:37:25 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:37:25 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:37:25 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:37:25 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:37:25 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:37:25 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:37:25 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:37:25 user nova-compute[74534]:       <nova:owner>
Nov 02 12:37:25 user nova-compute[74534]:         <nova:user uuid="28dcfc55e70c43b6ba92dfc1ea4c29ce">tempest-VolumesSnapshotTestJSON-1611265569-project-member</nova:user>
Nov 02 12:37:25 user nova-compute[74534]:         <nova:project uuid="60125df414f34e7a9cbe85b15fd1808e">tempest-VolumesSnapshotTestJSON-1611265569</nova:project>
Nov 02 12:37:25 user nova-compute[74534]:       </nova:owner>
Nov 02 12:37:25 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 12:37:25 user nova-compute[74534]:       <nova:ports>
Nov 02 12:37:25 user nova-compute[74534]:         <nova:port uuid="29cd8641-8c80-4794-a334-14fe4fe1ea22">
Nov 02 12:37:25 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 12:37:25 user nova-compute[74534]:         </nova:port>
Nov 02 12:37:25 user nova-compute[74534]:       </nova:ports>
Nov 02 12:37:25 user nova-compute[74534]:     </nova:instance>
Nov 02 12:37:25 user nova-compute[74534]:   </metadata>
Nov 02 12:37:25 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:37:25 user nova-compute[74534]:     <system>
Nov 02 12:37:25 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:37:25 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:37:25 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:37:25 user nova-compute[74534]:       <entry name="serial">c065f4c9-250c-4cac-817f-4ed7ea9b6ca9</entry>
Nov 02 12:37:25 user nova-compute[74534]:       <entry name="uuid">c065f4c9-250c-4cac-817f-4ed7ea9b6ca9</entry>
Nov 02 12:37:25 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:37:25 user nova-compute[74534]:     </system>
Nov 02 12:37:25 user nova-compute[74534]:   </sysinfo>
Nov 02 12:37:25 user nova-compute[74534]:   <os>
Nov 02 12:37:25 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:37:25 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:37:25 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:37:25 user nova-compute[74534]:   </os>
Nov 02 12:37:25 user nova-compute[74534]:   <features>
Nov 02 12:37:25 user nova-compute[74534]:     <acpi/>
Nov 02 12:37:25 user nova-compute[74534]:     <apic/>
Nov 02 12:37:25 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:37:25 user nova-compute[74534]:   </features>
Nov 02 12:37:25 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:37:25 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:37:25 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:37:25 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:37:25 user nova-compute[74534]:   </clock>
Nov 02 12:37:25 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:37:25 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:37:25 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:37:25 user nova-compute[74534]:   </cpu>
Nov 02 12:37:25 user nova-compute[74534]:   <devices>
Nov 02 12:37:25 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:37:25 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:37:25 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk"/>
Nov 02 12:37:25 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:37:25 user nova-compute[74534]:     </disk>
Nov 02 12:37:25 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:37:25 user nova-compute[74534]:       <mac address="fa:16:3e:90:07:f6"/>
Nov 02 12:37:25 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:37:25 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:37:25 user nova-compute[74534]:       <target dev="tap29cd8641-8c"/>
Nov 02 12:37:25 user nova-compute[74534]:     </interface>
Nov 02 12:37:25 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:37:25 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/console.log" append="off"/>
Nov 02 12:37:25 user nova-compute[74534]:     </serial>
Nov 02 12:37:25 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:37:25 user nova-compute[74534]:     <video>
Nov 02 12:37:25 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:37:25 user nova-compute[74534]:     </video>
Nov 02 12:37:25 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:37:25 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:37:25 user nova-compute[74534]:     </rng>
Nov 02 12:37:25 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:37:25 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:37:25 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:37:25 user nova-compute[74534]:     </memballoon>
Nov 02 12:37:25 user nova-compute[74534]:   </devices>
Nov 02 12:37:25 user nova-compute[74534]: </domain>
Nov 02 12:37:25 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1530462440',display_name='tempest-VolumesSnapshotTestJSON-instance-1530462440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1530462440',id=45,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdml6A5QV6qyjHIZkeGE2LWJAwajLglv5+6jQ7noWfdroZW0xmcHbt9Y5fFoPmgsuAmce/UWZkYfTg7suDEjmcWU3jYl4m54ZhDWzRa08d4HQL2tzBQquEwnlQX9hN/bw==',key_name='tempest-keypair-1746948359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60125df414f34e7a9cbe85b15fd1808e',ramdisk_id='',reservation_id='r-4utcf7va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1611265569',owner_user_name='tempest-VolumesSnapshotTestJSON-1611265569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28dcfc55e70c43b6ba92dfc1ea4c29ce',uuid=c065f4c9-250c-4cac-817f-4ed7ea9b6ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converting VIF {"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=29cd8641-8c80-4794-a334-14fe4fe1ea22,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29cd8641-8c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG os_vif [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=29cd8641-8c80-4794-a334-14fe4fe1ea22,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29cd8641-8c') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f481621f-c962-521a-860a-c0da9f5ab9cd', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29cd8641-8c, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29cd8641-8c, col_values=(('qos', UUID('9a688bd0-0386-439e-a88e-ea90a5cddd06')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29cd8641-8c, col_values=(('external_ids', {'iface-id': '29cd8641-8c80-4794-a334-14fe4fe1ea22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:07:f6', 'vm-uuid': 'c065f4c9-250c-4cac-817f-4ed7ea9b6ca9'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:25 user nova-compute[74534]: INFO os_vif [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=29cd8641-8c80-4794-a334-14fe4fe1ea22,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29cd8641-8c')
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:37:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No VIF found with MAC fa:16:3e:90:07:f6, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:37:26 user nova-compute[74534]: DEBUG nova.network.neutron [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updated VIF entry in instance network info cache for port 29cd8641-8c80-4794-a334-14fe4fe1ea22. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:37:26 user nova-compute[74534]: DEBUG nova.network.neutron [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updating instance_info_cache with network_info: [{"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-625bdd31-4e6d-4f62-822c-981840cce5ca req-b0f6cb4f-3e87-4ccc-812f-4024601e083c service nova] Releasing lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:37:26 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5a2645f-a401-4eab-b5b8-3077a37bf22a req-005ae689-3b08-48aa-909d-3fb7bf6c4e55 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5a2645f-a401-4eab-b5b8-3077a37bf22a req-005ae689-3b08-48aa-909d-3fb7bf6c4e55 service nova] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5a2645f-a401-4eab-b5b8-3077a37bf22a req-005ae689-3b08-48aa-909d-3fb7bf6c4e55 service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5a2645f-a401-4eab-b5b8-3077a37bf22a req-005ae689-3b08-48aa-909d-3fb7bf6c4e55 service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5a2645f-a401-4eab-b5b8-3077a37bf22a req-005ae689-3b08-48aa-909d-3fb7bf6c4e55 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] No waiting events found dispatching network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:37:27 user nova-compute[74534]: WARNING nova.compute.manager [req-b5a2645f-a401-4eab-b5b8-3077a37bf22a req-005ae689-3b08-48aa-909d-3fb7bf6c4e55 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received unexpected event network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 for instance with vm_state building and task_state spawning.
Nov 02 12:37:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:37:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Instance spawned successfully.
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-945b83cd-4fdc-43c8-a322-215f0501b760 req-84e5e069-ae47-44e6-ab45-2ce22ee8f013 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-945b83cd-4fdc-43c8-a322-215f0501b760 req-84e5e069-ae47-44e6-ab45-2ce22ee8f013 service nova] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-945b83cd-4fdc-43c8-a322-215f0501b760 req-84e5e069-ae47-44e6-ab45-2ce22ee8f013 service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-945b83cd-4fdc-43c8-a322-215f0501b760 req-84e5e069-ae47-44e6-ab45-2ce22ee8f013 service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.compute.manager [req-945b83cd-4fdc-43c8-a322-215f0501b760 req-84e5e069-ae47-44e6-ab45-2ce22ee8f013 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] No waiting events found dispatching network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:37:29 user nova-compute[74534]: WARNING nova.compute.manager [req-945b83cd-4fdc-43c8-a322-215f0501b760 req-84e5e069-ae47-44e6-ab45-2ce22ee8f013 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received unexpected event network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 for instance with vm_state building and task_state spawning.
Nov 02 12:37:29 user nova-compute[74534]: INFO nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 02 12:37:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:37:29 user nova-compute[74534]: INFO nova.compute.manager [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Took 6.26 seconds to build instance.
Nov 02 12:37:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5d19cf23-328b-4225-bd2a-ed759468dcbf tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.345s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:33 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:37:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:37:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG nova.compute.manager [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing instance network info cache due to event network-changed-e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] Acquiring lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] Acquired lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Refreshing network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:55 user nova-compute[74534]: INFO nova.compute.manager [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Terminating instance
Nov 02 12:37:55 user nova-compute[74534]: DEBUG nova.compute.manager [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updated VIF entry in instance network info cache for port e6acc48f-32bc-471e-ad2b-95e716bd5ed7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG nova.network.neutron [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [{"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-8d546e7e-697a-47d6-89df-052cb8dd09d4 req-ae581b71-30c9-4601-8a5a-de50a5d12de0 service nova] Releasing lock "refresh_cache-e001e47a-a442-46c8-bd8f-9c559d6b2804" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:37:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Instance destroyed successfully.
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lazy-loading 'resources' on Instance uuid e001e47a-a442-46c8-bd8f-9c559d6b2804 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1763021455',display_name='tempest-TestShelveInstance-server-1763021455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1763021455',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkCgqkkBJZKzrsOKTvhhR7nKXvAZAo6vKsJvPlHFeKniBX9AayaCvO3DyNbHBVhUtHkKNWXfYketpZ5lUFWJtR4UsPfDcw2+zT8J4xARfu1iUlUeYJQY+CBcM97L8ndAA==',key_name='tempest-TestShelveInstance-1089529071',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1527fb853264bc98715200025614b00',ramdisk_id='',reservation_id='r-gl5wpj2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-995727009',owner_user_name='tempest-TestShelveInstance-995727009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:36:41Z,user_data=None,user_id='d419025c7db34ae0bbce5f4ad1593b38',uuid=e001e47a-a442-46c8-bd8f-9c559d6b2804,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converting VIF {"id": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "address": "fa:16:3e:7f:bb:ea", "network": {"id": "b612c9a4-c5dd-4c6e-a425-f991c9150e76", "bridge": "br-int", "label": "tempest-TestShelveInstance-176078615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1527fb853264bc98715200025614b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6acc48f-32", "ovs_interfaceid": "e6acc48f-32bc-471e-ad2b-95e716bd5ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_vif [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6acc48f-32, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c665bdc2-310f-4ac5-867a-f3fcda82f825) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:37:56 user nova-compute[74534]: INFO os_vif [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bb:ea,bridge_name='br-int',has_traffic_filtering=True,id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7,network=Network(b612c9a4-c5dd-4c6e-a425-f991c9150e76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6acc48f-32')
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLQFJdxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:37:56 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05bc63e-e2ff-4cfd-82b0-ff61ba4edcdc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:37:56 user nova-compute[74534]: No targets found.
Nov 02 12:37:56 user nova-compute[74534]: iSNS:
Nov 02 12:37:56 user nova-compute[74534]: No targets found.
Nov 02 12:37:56 user nova-compute[74534]: STATIC:
Nov 02 12:37:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f
Nov 02 12:37:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:37:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:37:56 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79
Nov 02 12:37:56 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:37:56 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:37:56 user nova-compute[74534]: FIRMWARE:
Nov 02 12:37:56 user nova-compute[74534]: No targets found.
Nov 02 12:37:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:37:56 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:37:56 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59ac91e-7389-4f02-b9c1-9d3e56878208]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4d55ad-e9ef-4794-adc8-fd7c0b84c1ed]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:37:56 user nova-compute[74534]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)
Nov 02 12:37:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 (non-flash)
Nov 02 12:37:56 user nova-compute[74534]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)
Nov 02 12:37:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c5b00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e592a-0c3a-4c99-b3b7-d15d4e1cd0bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d30a3-b6df-48de-9e68-1231e93ba5aa]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b01f5-0869-4dbc-906f-ea89abc50115]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f421d-f97c-46b8-a833-f91daf0eba67]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7d3d976d', '/dev/disk/by-id/scsi-23639326433633863', '/dev/disk/by-id/scsi-1SCST_BIO7d3d976d-692d3c8c3fe14f9c') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a51468-6613-4f6f-bea3-bb1bcc12f76f]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5046f496-326b-42f7-8dba-71996e15d2f5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[21190855-dd4f-46b8-b728-1cc6d406d329]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260]
Nov 02 12:37:56 user nova-compute[74534]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79, portal: 172.16.0.220,3260] successful.
Nov 02 12:37:56 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebdf81f-8a95-467a-831b-58e8c87a9a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b79141-112a-4004-9c58-48f3b7173490]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] <== disconnect_volume: return (316ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:37:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Deleting instance files /opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804_del
Nov 02 12:37:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Deletion of /opt/stack/data/nova/instances/e001e47a-a442-46c8-bd8f-9c559d6b2804_del complete
Nov 02 12:37:56 user nova-compute[74534]: INFO nova.compute.manager [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:56 user nova-compute[74534]: INFO nova.compute.manager [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Unshelving
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'pci_requests' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'numa_topology' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:37:56 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:37:56 user nova-compute[74534]: INFO nova.compute.claims [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Claim successful on node user
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:57 user nova-compute[74534]: INFO nova.network.neutron [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating port 6abce6fb-adf1-4961-84ea-2ecc2569845f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 12:37:57 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Took 0.49 seconds to deallocate network for instance.
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-e9686780-93d6-4bbd-9516-b2af425a00ea req-5eba95f5-5fe8-43ae-8588-df83b5047593 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-deleted-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:57 user nova-compute[74534]: INFO nova.compute.manager [req-e9686780-93d6-4bbd-9516-b2af425a00ea req-5eba95f5-5fe8-43ae-8588-df83b5047593 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Neutron deleted interface e6acc48f-32bc-471e-ad2b-95e716bd5ed7; detaching it from the instance and deleting it from the info cache
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.network.neutron [req-e9686780-93d6-4bbd-9516-b2af425a00ea req-5eba95f5-5fe8-43ae-8588-df83b5047593 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-e9686780-93d6-4bbd-9516-b2af425a00ea req-5eba95f5-5fe8-43ae-8588-df83b5047593 service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Detach interface failed, port_id=e6acc48f-32bc-471e-ad2b-95e716bd5ed7, reason: Instance e001e47a-a442-46c8-bd8f-9c559d6b2804 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-unplugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-unplugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-unplugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] Acquiring lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] No waiting events found dispatching network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:37:57 user nova-compute[74534]: WARNING nova.compute.manager [req-b5d7b794-0f48-46ae-9d88-dff4bdd518b5 req-a830e5e0-4bbb-4b61-beb6-7b36b541653c service nova] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Received unexpected event network-vif-plugged-e6acc48f-32bc-471e-ad2b-95e716bd5ed7 for instance with vm_state active and task_state deleting.
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquired lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.network.neutron [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing instance network info cache due to event network-changed-6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:37:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] Acquiring lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:37:58 user nova-compute[74534]: INFO nova.compute.manager [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Took 0.94 seconds to detach 1 volumes for instance.
Nov 02 12:37:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] [instance: e001e47a-a442-46c8-bd8f-9c559d6b2804] Deleting volume: 0ebdf81f-8a95-467a-831b-58e8c87a9a79 {{(pid=74534) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG nova.network.neutron [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Releasing lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:37:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Creating image(s)
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.123s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG nova.objects.instance [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'trusted_certs' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] Acquired lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Refreshing network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG nova.objects.base [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<e332c657-ebf8-4e04-8aaf-ba824ba18286> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "c81e9fb918556f862d6d2cbc70c21850d524eee2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:37:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "c81e9fb918556f862d6d2cbc70c21850d524eee2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.part --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.211s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG nova.virt.images [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] 91ccb259-cd80-4f96-ae47-4c55caa836fa was qcow2, converting to raw {{(pid=74534) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG nova.privsep.utils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74534) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.part /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.converted {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:37:59 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Deleted allocations for instance e001e47a-a442-46c8-bd8f-9c559d6b2804
Nov 02 12:37:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-02101635-7534-43b1-aaf6-af009dff7c1f tempest-TestShelveInstance-995727009 tempest-TestShelveInstance-995727009-project-member] Lock "e001e47a-a442-46c8-bd8f-9c559d6b2804" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.329s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updated VIF entry in instance network info cache for port 6abce6fb-adf1-4961-84ea-2ecc2569845f. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG nova.network.neutron [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d7e5979d-7024-40eb-8f07-97208f31cedf req-a37b0dcd-d526-4ee7-8481-6af7517be11e service nova] Releasing lock "refresh_cache-e332c657-ebf8-4e04-8aaf-ba824ba18286" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:37:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.part /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.converted" returned: 0 in 0.277s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.converted --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "c81e9fb918556f862d6d2cbc70c21850d524eee2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.744s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2 --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "c81e9fb918556f862d6d2cbc70c21850d524eee2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "c81e9fb918556f862d6d2cbc70c21850d524eee2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2,backing_fmt=raw /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2,backing_fmt=raw /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk 1073741824" returned: 0 in 0.053s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "c81e9fb918556f862d6d2cbc70c21850d524eee2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2 --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2 --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG nova.objects.instance [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'migration_context' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG nova.objects.base [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<e332c657-ebf8-4e04-8aaf-ba824ba18286> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:38:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Rebasing disk image.
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.167s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe -F raw /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe -F raw /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk" returned: 0 in 1.822s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Ensure instance console log exists: /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Start _get_guest_xml network_info=[{"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e7b41e5cd64e4981b4f2f1470d6e9345',container_format='bare',created_at=2023-11-02T12:36:04Z,direct_url=<?>,disk_format='qcow2',id=91ccb259-cd80-4f96-ae47-4c55caa836fa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1891563097-shelved',owner='2f367e2b6b094dbcb26fe289d0eda148',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T12:36:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:38:02 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:38:02 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e7b41e5cd64e4981b4f2f1470d6e9345',container_format='bare',created_at=2023-11-02T12:36:04Z,direct_url=<?>,disk_format='qcow2',id=91ccb259-cd80-4f96-ae47-4c55caa836fa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1891563097-shelved',owner='2f367e2b6b094dbcb26fe289d0eda148',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T12:36:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.objects.instance [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'vcpu_model' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.objects.base [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<e332c657-ebf8-4e04-8aaf-ba824ba18286> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891563097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891563097',id=43,image_ref='91ccb259-cd80-4f96-ae47-4c55caa836fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1095099930',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-fngaxt17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member',shelved_at='2023-11-02T12:36:08.486561',shelved_host='user',shelved_image_id='91ccb259-cd80-4f96-ae47-4c55caa836fa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=e332c657-ebf8-4e04-8aaf-ba824ba18286,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.objects.instance [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'pci_devices' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.objects.base [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Object Instance<e332c657-ebf8-4e04-8aaf-ba824ba18286> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74534) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:38:02 user nova-compute[74534]:   <uuid>e332c657-ebf8-4e04-8aaf-ba824ba18286</uuid>
Nov 02 12:38:02 user nova-compute[74534]:   <name>instance-0000002b</name>
Nov 02 12:38:02 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:38:02 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:38:02 user nova-compute[74534]:   <metadata>
Nov 02 12:38:02 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:38:02 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:38:02 user nova-compute[74534]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1891563097</nova:name>
Nov 02 12:38:02 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:38:02</nova:creationTime>
Nov 02 12:38:02 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:38:02 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:38:02 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:38:02 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:38:02 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:38:02 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:38:02 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:38:02 user nova-compute[74534]:       <nova:owner>
Nov 02 12:38:02 user nova-compute[74534]:         <nova:user uuid="6cc8a90d5468473dae411475ada29ba6">tempest-AttachVolumeShelveTestJSON-616827552-project-member</nova:user>
Nov 02 12:38:02 user nova-compute[74534]:         <nova:project uuid="2f367e2b6b094dbcb26fe289d0eda148">tempest-AttachVolumeShelveTestJSON-616827552</nova:project>
Nov 02 12:38:02 user nova-compute[74534]:       </nova:owner>
Nov 02 12:38:02 user nova-compute[74534]:       <nova:root type="image" uuid="91ccb259-cd80-4f96-ae47-4c55caa836fa"/>
Nov 02 12:38:02 user nova-compute[74534]:       <nova:ports>
Nov 02 12:38:02 user nova-compute[74534]:         <nova:port uuid="6abce6fb-adf1-4961-84ea-2ecc2569845f">
Nov 02 12:38:02 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 12:38:02 user nova-compute[74534]:         </nova:port>
Nov 02 12:38:02 user nova-compute[74534]:       </nova:ports>
Nov 02 12:38:02 user nova-compute[74534]:     </nova:instance>
Nov 02 12:38:02 user nova-compute[74534]:   </metadata>
Nov 02 12:38:02 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:38:02 user nova-compute[74534]:     <system>
Nov 02 12:38:02 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:38:02 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:38:02 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:38:02 user nova-compute[74534]:       <entry name="serial">e332c657-ebf8-4e04-8aaf-ba824ba18286</entry>
Nov 02 12:38:02 user nova-compute[74534]:       <entry name="uuid">e332c657-ebf8-4e04-8aaf-ba824ba18286</entry>
Nov 02 12:38:02 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:38:02 user nova-compute[74534]:     </system>
Nov 02 12:38:02 user nova-compute[74534]:   </sysinfo>
Nov 02 12:38:02 user nova-compute[74534]:   <os>
Nov 02 12:38:02 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:38:02 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:38:02 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:38:02 user nova-compute[74534]:   </os>
Nov 02 12:38:02 user nova-compute[74534]:   <features>
Nov 02 12:38:02 user nova-compute[74534]:     <acpi/>
Nov 02 12:38:02 user nova-compute[74534]:     <apic/>
Nov 02 12:38:02 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:38:02 user nova-compute[74534]:   </features>
Nov 02 12:38:02 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:38:02 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:38:02 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:38:02 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:38:02 user nova-compute[74534]:   </clock>
Nov 02 12:38:02 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:38:02 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:38:02 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:38:02 user nova-compute[74534]:   </cpu>
Nov 02 12:38:02 user nova-compute[74534]:   <devices>
Nov 02 12:38:02 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 12:38:02 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 12:38:02 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk"/>
Nov 02 12:38:02 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:38:02 user nova-compute[74534]:     </disk>
Nov 02 12:38:02 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:38:02 user nova-compute[74534]:       <mac address="fa:16:3e:91:1c:ac"/>
Nov 02 12:38:02 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:38:02 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:38:02 user nova-compute[74534]:       <target dev="tap6abce6fb-ad"/>
Nov 02 12:38:02 user nova-compute[74534]:     </interface>
Nov 02 12:38:02 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:38:02 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/console.log" append="off"/>
Nov 02 12:38:02 user nova-compute[74534]:     </serial>
Nov 02 12:38:02 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:38:02 user nova-compute[74534]:     <video>
Nov 02 12:38:02 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:38:02 user nova-compute[74534]:     </video>
Nov 02 12:38:02 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:38:02 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:38:02 user nova-compute[74534]:     </rng>
Nov 02 12:38:02 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:38:02 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:38:02 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:38:02 user nova-compute[74534]:     </memballoon>
Nov 02 12:38:02 user nova-compute[74534]:   </devices>
Nov 02 12:38:02 user nova-compute[74534]: </domain>
Nov 02 12:38:02 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891563097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891563097',id=43,image_ref='91ccb259-cd80-4f96-ae47-4c55caa836fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1095099930',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-fngaxt17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member',shelved_at='2023-11-02T12:36:08.486561',shelved_host='user',shelved_image_id='91ccb259-cd80-4f96-ae47-4c55caa836fa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=e332c657-ebf8-4e04-8aaf-ba824ba18286,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG os_vif [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07ca67b5-965b-58cc-a2ef-4b3263b6c8a9', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6abce6fb-ad, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6abce6fb-ad, col_values=(('qos', UUID('af47177a-8a36-461e-9343-ec791ba86a33')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6abce6fb-ad, col_values=(('external_ids', {'iface-id': '6abce6fb-adf1-4961-84ea-2ecc2569845f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:1c:ac', 'vm-uuid': 'e332c657-ebf8-4e04-8aaf-ba824ba18286'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:02 user nova-compute[74534]: INFO os_vif [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad')
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:38:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] No VIF found with MAC fa:16:3e:91:1c:ac, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-32b5afea-e681-4334-bac8-a1c4f9cddc83 req-696ae53f-fd9e-4e06-9b9f-24d4805cdce4 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-32b5afea-e681-4334-bac8-a1c4f9cddc83 req-696ae53f-fd9e-4e06-9b9f-24d4805cdce4 service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-32b5afea-e681-4334-bac8-a1c4f9cddc83 req-696ae53f-fd9e-4e06-9b9f-24d4805cdce4 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-32b5afea-e681-4334-bac8-a1c4f9cddc83 req-696ae53f-fd9e-4e06-9b9f-24d4805cdce4 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-32b5afea-e681-4334-bac8-a1c4f9cddc83 req-696ae53f-fd9e-4e06-9b9f-24d4805cdce4 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:38:04 user nova-compute[74534]: WARNING nova.compute.manager [req-32b5afea-e681-4334-bac8-a1c4f9cddc83 req-696ae53f-fd9e-4e06-9b9f-24d4805cdce4 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received unexpected event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 12:38:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:38:06 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:38:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance spawned successfully.
Nov 02 12:38:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-064eccf7-0d08-4cd2-adba-b5adac570c61 req-a599a515-e4de-4baa-8c2a-43d7c0f61158 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:38:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-064eccf7-0d08-4cd2-adba-b5adac570c61 req-a599a515-e4de-4baa-8c2a-43d7c0f61158 service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:38:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-064eccf7-0d08-4cd2-adba-b5adac570c61 req-a599a515-e4de-4baa-8c2a-43d7c0f61158 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:38:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-064eccf7-0d08-4cd2-adba-b5adac570c61 req-a599a515-e4de-4baa-8c2a-43d7c0f61158 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-064eccf7-0d08-4cd2-adba-b5adac570c61 req-a599a515-e4de-4baa-8c2a-43d7c0f61158 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:38:06 user nova-compute[74534]: WARNING nova.compute.manager [req-064eccf7-0d08-4cd2-adba-b5adac570c61 req-a599a515-e4de-4baa-8c2a-43d7c0f61158 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received unexpected event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 12:38:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:38:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-461ffe30-1625-4836-995b-0b3bf4429eaf tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.025s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:38:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:38:24 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:38:24 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:38:24 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=24.89309310913086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1341c98f-8281-4722-8159-a85f8503c021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e332c657-ebf8-4e04-8aaf-ba824ba18286 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:38:24 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:38:25 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:38:25 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:38:25 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:38:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:38:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:28 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:28 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:38:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing instance network info cache due to event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.network.neutron [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing instance network info cache due to event network-changed-9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.network.neutron [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated VIF entry in instance network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.network.neutron [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3b0f5f6f-1971-43fb-910e-b89b30760a29 req-76a423dc-077a-4613-9a4d-a67e02fd4436 service nova] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG nova.network.neutron [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Refreshing network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:38:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:38:43 user nova-compute[74534]: INFO nova.compute.manager [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Detaching volume 90338ef9-59ac-42ea-8bc2-1537062d5b5f
Nov 02 12:38:43 user nova-compute[74534]: INFO nova.virt.block_device [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Attempting to driver detach volume 90338ef9-59ac-42ea-8bc2-1537062d5b5f from mountpoint /dev/vdb
Nov 02 12:38:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Attempting to detach device vdb from instance 1341c98f-8281-4722-8159-a85f8503c021 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:38:43 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:38:43 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:38:43 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:38:43 user nova-compute[74534]:   <serial>90338ef9-59ac-42ea-8bc2-1537062d5b5f</serial>
Nov 02 12:38:43 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:38:43 user nova-compute[74534]: </disk>
Nov 02 12:38:43 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:38:43 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully detached device vdb from instance 1341c98f-8281-4722-8159-a85f8503c021 from the persistent domain config.
Nov 02 12:38:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1341c98f-8281-4722-8159-a85f8503c021 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:38:43 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:38:43 user nova-compute[74534]:   <source dev="/dev/sdc"/>
Nov 02 12:38:43 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:38:43 user nova-compute[74534]:   <serial>90338ef9-59ac-42ea-8bc2-1537062d5b5f</serial>
Nov 02 12:38:43 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:38:43 user nova-compute[74534]: </disk>
Nov 02 12:38:43 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG nova.network.neutron [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated VIF entry in instance network info cache for port 9a05401b-26e3-4010-b2d6-36c034f222d5. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG nova.network.neutron [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2870af5f-68a2-45d9-9828-0742e8f512f6 req-fe6a2b6c-f96b-4536-82bc-1e8b772db52a service nova] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:38:43 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:38:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:38:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:39:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:39:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:39:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:03 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1341c98f-8281-4722-8159-a85f8503c021 is timed out.
Nov 02 12:39:03 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully detached device vdb from instance 1341c98f-8281-4722-8159-a85f8503c021 from the live domain config.
Nov 02 12:39:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPScADCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:39:03 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2131253-e635-45be-a2af-e67f11596006]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:39:03 user nova-compute[74534]: No targets found.
Nov 02 12:39:03 user nova-compute[74534]: iSNS:
Nov 02 12:39:03 user nova-compute[74534]: No targets found.
Nov 02 12:39:03 user nova-compute[74534]: STATIC:
Nov 02 12:39:03 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f
Nov 02 12:39:03 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:39:03 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:39:03 user nova-compute[74534]: FIRMWARE:
Nov 02 12:39:03 user nova-compute[74534]: No targets found.
Nov 02 12:39:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:39:03 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:39:03 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d21b4-8583-49d7-9029-5064d98e454c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[450713cf-37b1-42c5-9617-58ec0f64f166]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)
Nov 02 12:39:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f (non-flash)
Nov 02 12:39:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c7d5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf9d2aa-8890-4294-ae15-5241cba14816]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68d2f2-1981-4234-966f-c4b50b23acac]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[09929b3b-108f-4bd7-8f53-0296acbde058]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded00f5-b80e-4b19-b8b7-201d1ed81a8b]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f331e9-727c-4efe-9550-b9e7ab12f272]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[052a3197-8e1b-423a-bf27-9244243919f8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260]
Nov 02 12:39:03 user nova-compute[74534]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f, portal: 172.16.0.220,3260] successful.
Nov 02 12:39:03 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90338ef9-59ac-42ea-8bc2-1537062d5b5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d22341d-7737-467d-a35d-fc33b57027d6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] <== disconnect_volume: return (307ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:39:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:39:04 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'flavor' on Instance uuid 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:39:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a59cc3ab-8eb2-44f5-8070-847488c8fce4 tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-changed-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:39:13 user nova-compute[74534]: DEBUG nova.compute.manager [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Refreshing instance network info cache due to event network-changed-29cd8641-8c80-4794-a334-14fe4fe1ea22. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:39:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] Acquiring lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:39:13 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] Acquired lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:39:13 user nova-compute[74534]: DEBUG nova.network.neutron [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Refreshing network info cache for port 29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'flavor' on Instance uuid c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:39:14 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Ignoring supplied device name: /dev/vdb
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:14 user nova-compute[74534]: INFO nova.compute.manager [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Attaching volume bc4bb253-488f-4467-927e-1b78c31a8487 to /dev/vdb
Nov 02 12:39:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updated VIF entry in instance network info cache for port 29cd8641-8c80-4794-a334-14fe4fe1ea22. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG nova.network.neutron [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updating instance_info_cache with network_info: [{"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-78b3b41d-a37b-41b3-aa40-0351ca12ed79 req-f3bb43b6-7702-412b-ac34-2e01d0261ef8 service nova] Releasing lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff89c36-782e-4225-8bfc-f2a33fda7cbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61f848-5442-4e64-b9df-cfc9a9188299]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df0f26b-596d-40b8-8e24-ef169eb39ac3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0fdc8b-e16d-4196-98a1-7578dc30caa9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:39:14 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:39:14 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5384c03-5ea9-47f8-bc98-7e3bbf49acaa]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG os_brick.utils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:39:14 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updating existing volume attachment record: 6aa101bc-5606-4158-9d60-6ee5c91421a6 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:39:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:18 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:39:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [{"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-1341c98f-8281-4722-8159-a85f8503c021" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:39:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:25 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:39:25 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:39:25 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=24.891448974609375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:39:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 1341c98f-8281-4722-8159-a85f8503c021 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance e332c657-ebf8-4e04-8aaf-ba824ba18286 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:39:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUbIGZAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:39:33 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:39:33 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:39:33 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[70442663-16e0-401a-bc19-3ffd7afc6974]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:39:33 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba928d7c-25bb-4cff-94cf-63947335dfe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487] added
Nov 02 12:39:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec6c55-d6bb-4d29-b29b-39dfbaf1c4e0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a8358e-22ab-4f0c-9a04-d0e8dc6d3784]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUbIGZAw {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUbIGZAw" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef66a2a-843f-4f30-b59f-b163150f2156]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUbIGZAw'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe562e-8e72-40bd-8cb3-5a6b5f82ef26]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c8346d-1cb7-44cf-980f-1b6406bf4acb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:39:33 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:39:33 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:39:33 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:39:33 user nova-compute[74534]: 
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e58672-1529-4ad4-97ad-8a292df1c2f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260]
Nov 02 12:39:33 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260] successful.
Nov 02 12:39:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ea751-74a8-44cf-97a2-229a478ece33]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f272db8-b996-486d-b1f4-f9df7803e781]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 (non-flash)
Nov 02 12:39:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 (non-flash)
Nov 02 12:39:33 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aac785-fa04-47b4-8edf-c2032e3392ab]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:39:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUbIGZAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:39:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:39:34 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26435643330396235', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:39:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435643330396235', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:39:34 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'flavor' on Instance uuid c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:39:34 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 12:39:34 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:39:34 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:39:34 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:39:34 user nova-compute[74534]:   <serial>bc4bb253-488f-4467-927e-1b78c31a8487</serial>
Nov 02 12:39:34 user nova-compute[74534]: </disk>
Nov 02 12:39:34 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 12:39:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:39:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:39:35 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] No VIF found with MAC fa:16:3e:90:07:f6, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:39:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a5795b5f-4e9e-4209-916b-e811ea366f68 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.817s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:44 user nova-compute[74534]: INFO nova.compute.manager [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Terminating instance
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-ec1bb1b7-276d-4620-8d70-12814b9754c0 req-cfa45195-6fce-4068-b520-f6d47585b8b1 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-unplugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ec1bb1b7-276d-4620-8d70-12814b9754c0 req-cfa45195-6fce-4068-b520-f6d47585b8b1 service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ec1bb1b7-276d-4620-8d70-12814b9754c0 req-cfa45195-6fce-4068-b520-f6d47585b8b1 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ec1bb1b7-276d-4620-8d70-12814b9754c0 req-cfa45195-6fce-4068-b520-f6d47585b8b1 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-ec1bb1b7-276d-4620-8d70-12814b9754c0 req-cfa45195-6fce-4068-b520-f6d47585b8b1 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-unplugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-ec1bb1b7-276d-4620-8d70-12814b9754c0 req-cfa45195-6fce-4068-b520-f6d47585b8b1 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-unplugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Instance destroyed successfully.
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.objects.instance [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lazy-loading 'resources' on Instance uuid 1341c98f-8281-4722-8159-a85f8503c021 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-73474126',display_name='tempest-TestMinimumBasicScenario-server-73474126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-73474126',id=44,image_ref='d40c5886-2bf0-4cf4-9143-599a7f37ef05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3lAgrwjVUE2S67OpYw1+/QyWj2ayIKdh+0S14gLI3D2JxCuv8k7+Zul5E7PALJNgLOJN21wAnhWlNuNgAvrJ7oT/SnLiB9nl5B1XGtufIubGJIQO10k3KzHMkwewD1tw==',key_name='tempest-TestMinimumBasicScenario-1457327264',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:34:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1851244b13ac4d26a5ffabc047210b4d',ramdisk_id='',reservation_id='r-o8o3ulc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d40c5886-2bf0-4cf4-9143-599a7f37ef05',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-388517270',owner_user_name='tempest-TestMinimumBasicScenario-388517270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:36:58Z,user_data=None,user_id='dac1b3b4e45d42839c9a9413baa0fcec',uuid=1341c98f-8281-4722-8159-a85f8503c021,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converting VIF {"id": "9a05401b-26e3-4010-b2d6-36c034f222d5", "address": "fa:16:3e:26:93:2b", "network": {"id": "a1e95d3c-17a3-4743-ad00-d7ca76e96652", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1837724068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1851244b13ac4d26a5ffabc047210b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a05401b-26", "ovs_interfaceid": "9a05401b-26e3-4010-b2d6-36c034f222d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:93:2b,bridge_name='br-int',has_traffic_filtering=True,id=9a05401b-26e3-4010-b2d6-36c034f222d5,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a05401b-26') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG os_vif [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:93:2b,bridge_name='br-int',has_traffic_filtering=True,id=9a05401b-26e3-4010-b2d6-36c034f222d5,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a05401b-26') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a05401b-26, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1d63f62-b51a-4084-a0e6-d1676e771151) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:44 user nova-compute[74534]: INFO os_vif [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:93:2b,bridge_name='br-int',has_traffic_filtering=True,id=9a05401b-26e3-4010-b2d6-36c034f222d5,network=Network(a1e95d3c-17a3-4743-ad00-d7ca76e96652),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a05401b-26')
Nov 02 12:39:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Deleting instance files /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021_del
Nov 02 12:39:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Deletion of /opt/stack/data/nova/instances/1341c98f-8281-4722-8159-a85f8503c021_del complete
Nov 02 12:39:44 user nova-compute[74534]: INFO nova.compute.manager [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 12:39:44 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:39:44 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1341c98f-8281-4722-8159-a85f8503c021] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:39:45 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:39:45 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Took 0.48 seconds to deallocate network for instance.
Nov 02 12:39:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:45 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:39:45 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:39:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:45 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Deleted allocations for instance 1341c98f-8281-4722-8159-a85f8503c021
Nov 02 12:39:45 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b28b425a-6bf5-49cb-9e89-af838d9239ec tempest-TestMinimumBasicScenario-388517270 tempest-TestMinimumBasicScenario-388517270-project-member] Lock "1341c98f-8281-4722-8159-a85f8503c021" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-ede80485-5837-4884-8b6f-dae571f7ab92 req-a386d98f-458f-4585-a766-862e22f611a4 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:39:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ede80485-5837-4884-8b6f-dae571f7ab92 req-a386d98f-458f-4585-a766-862e22f611a4 service nova] Acquiring lock "1341c98f-8281-4722-8159-a85f8503c021-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ede80485-5837-4884-8b6f-dae571f7ab92 req-a386d98f-458f-4585-a766-862e22f611a4 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ede80485-5837-4884-8b6f-dae571f7ab92 req-a386d98f-458f-4585-a766-862e22f611a4 service nova] Lock "1341c98f-8281-4722-8159-a85f8503c021-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-ede80485-5837-4884-8b6f-dae571f7ab92 req-a386d98f-458f-4585-a766-862e22f611a4 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] No waiting events found dispatching network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:39:46 user nova-compute[74534]: WARNING nova.compute.manager [req-ede80485-5837-4884-8b6f-dae571f7ab92 req-a386d98f-458f-4585-a766-862e22f611a4 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received unexpected event network-vif-plugged-9a05401b-26e3-4010-b2d6-36c034f222d5 for instance with vm_state deleted and task_state None.
Nov 02 12:39:46 user nova-compute[74534]: DEBUG nova.compute.manager [req-ede80485-5837-4884-8b6f-dae571f7ab92 req-a386d98f-458f-4585-a766-862e22f611a4 service nova] [instance: 1341c98f-8281-4722-8159-a85f8503c021] Received event network-vif-deleted-9a05401b-26e3-4010-b2d6-36c034f222d5 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:47 user nova-compute[74534]: INFO nova.compute.manager [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Terminating instance
Nov 02 12:39:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdf6af09-8dad-4f35-8eb2-f7a8e58fdd9c req-bd100501-563d-4043-9a4a-207665323056 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-unplugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdf6af09-8dad-4f35-8eb2-f7a8e58fdd9c req-bd100501-563d-4043-9a4a-207665323056 service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdf6af09-8dad-4f35-8eb2-f7a8e58fdd9c req-bd100501-563d-4043-9a4a-207665323056 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-fdf6af09-8dad-4f35-8eb2-f7a8e58fdd9c req-bd100501-563d-4043-9a4a-207665323056 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdf6af09-8dad-4f35-8eb2-f7a8e58fdd9c req-bd100501-563d-4043-9a4a-207665323056 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-unplugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:39:47 user nova-compute[74534]: DEBUG nova.compute.manager [req-fdf6af09-8dad-4f35-8eb2-f7a8e58fdd9c req-bd100501-563d-4043-9a4a-207665323056 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-unplugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:39:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Instance destroyed successfully.
Nov 02 12:39:48 user nova-compute[74534]: DEBUG nova.objects.instance [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lazy-loading 'resources' on Instance uuid e332c657-ebf8-4e04-8aaf-ba824ba18286 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T12:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1891563097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1891563097',id=43,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Zs+NySjUoZG61Sjitv1zEk41zkTXJAiBelxKHhXIGPIdwV3hdKXZVBTQGGvIkgtF4YG4IV1tOR5KeXisENFHVR+KuMtf2quVDdJlpHwipOaGexV3j3IN+o6bPqSa2Fg==',key_name='tempest-keypair-1095099930',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f367e2b6b094dbcb26fe289d0eda148',ramdisk_id='',reservation_id='r-fngaxt17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-616827552',owner_user_name='tempest-AttachVolumeShelveTestJSON-616827552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6cc8a90d5468473dae411475ada29ba6',uuid=e332c657-ebf8-4e04-8aaf-ba824ba18286,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converting VIF {"id": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "address": "fa:16:3e:91:1c:ac", "network": {"id": "17a61b1a-95ed-41de-be48-4c44b9d795fe", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-832668943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f367e2b6b094dbcb26fe289d0eda148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6abce6fb-ad", "ovs_interfaceid": "6abce6fb-adf1-4961-84ea-2ecc2569845f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG os_vif [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6abce6fb-ad, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af47177a-8a36-461e-9343-ec791ba86a33) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:39:48 user nova-compute[74534]: INFO os_vif [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:1c:ac,bridge_name='br-int',has_traffic_filtering=True,id=6abce6fb-adf1-4961-84ea-2ecc2569845f,network=Network(17a61b1a-95ed-41de-be48-4c44b9d795fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6abce6fb-ad')
Nov 02 12:39:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Deleting instance files /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286_del
Nov 02 12:39:48 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Deletion of /opt/stack/data/nova/instances/e332c657-ebf8-4e04-8aaf-ba824ba18286_del complete
Nov 02 12:39:48 user nova-compute[74534]: INFO nova.compute.manager [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 02 12:39:48 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:39:48 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:39:49 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Took 0.96 seconds to deallocate network for instance.
Nov 02 12:39:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-04e60848-35b5-451e-a3f8-1821af4f046b req-2c8b3ad6-9794-4c61-8b47-03c54470e366 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-deleted-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:49 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Deleted allocations for instance e332c657-ebf8-4e04-8aaf-ba824ba18286
Nov 02 12:39:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-19437d74-a046-4851-8708-718c76abcf6d req-2ded39e9-0041-4c23-9d81-a397bb3a82a7 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-19437d74-a046-4851-8708-718c76abcf6d req-2ded39e9-0041-4c23-9d81-a397bb3a82a7 service nova] Acquiring lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-19437d74-a046-4851-8708-718c76abcf6d req-2ded39e9-0041-4c23-9d81-a397bb3a82a7 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-19437d74-a046-4851-8708-718c76abcf6d req-2ded39e9-0041-4c23-9d81-a397bb3a82a7 service nova] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:49 user nova-compute[74534]: DEBUG nova.compute.manager [req-19437d74-a046-4851-8708-718c76abcf6d req-2ded39e9-0041-4c23-9d81-a397bb3a82a7 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] No waiting events found dispatching network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:39:49 user nova-compute[74534]: WARNING nova.compute.manager [req-19437d74-a046-4851-8708-718c76abcf6d req-2ded39e9-0041-4c23-9d81-a397bb3a82a7 service nova] [instance: e332c657-ebf8-4e04-8aaf-ba824ba18286] Received unexpected event network-vif-plugged-6abce6fb-adf1-4961-84ea-2ecc2569845f for instance with vm_state deleted and task_state None.
Nov 02 12:39:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-4e3ee187-160d-4288-86f6-d72c12153fde tempest-AttachVolumeShelveTestJSON-616827552 tempest-AttachVolumeShelveTestJSON-616827552-project-member] Lock "e332c657-ebf8-4e04-8aaf-ba824ba18286" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.337s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:39:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:39:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:19 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:40:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updating instance_info_cache with network_info: [{"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:40:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:40:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:40:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=24.946094512939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:40:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:29 user nova-compute[74534]: INFO nova.compute.manager [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Detaching volume bc4bb253-488f-4467-927e-1b78c31a8487
Nov 02 12:40:29 user nova-compute[74534]: INFO nova.virt.block_device [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Attempting to driver detach volume bc4bb253-488f-4467-927e-1b78c31a8487 from mountpoint /dev/vdb
Nov 02 12:40:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Attempting to detach device vdb from instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 12:40:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:40:29 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:40:29 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:40:29 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:40:29 user nova-compute[74534]:   <serial>bc4bb253-488f-4467-927e-1b78c31a8487</serial>
Nov 02 12:40:29 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:40:29 user nova-compute[74534]: </disk>
Nov 02 12:40:29 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:40:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully detached device vdb from instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 from the persistent domain config.
Nov 02 12:40:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 12:40:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 12:40:29 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:40:29 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 12:40:29 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 12:40:29 user nova-compute[74534]:   <serial>bc4bb253-488f-4467-927e-1b78c31a8487</serial>
Nov 02 12:40:29 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 12:40:29 user nova-compute[74534]: </disk>
Nov 02 12:40:29 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 12:40:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 12:40:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Verify base images {{(pid=74534) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Image id 36642543-2106-4841-8acf-2e35b58c4209 yields fingerprint 8eafdd99856eea5f6f16814a3d78039f3d8ccafe {{(pid=74534) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] image 36642543-2106-4841-8acf-2e35b58c4209 at (/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe): checking
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] image 36642543-2106-4841-8acf-2e35b58c4209 at (/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe): image is in use {{(pid=74534) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74534) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 is a valid instance name {{(pid=74534) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 has a disk file {{(pid=74534) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 is backed by 8eafdd99856eea5f6f16814a3d78039f3d8ccafe {{(pid=74534) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241
Nov 02 12:40:48 user nova-compute[74534]: WARNING nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Unknown base file: /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Active base files: /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Removable base files: /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246 /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0 /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2 /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750 /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23 /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241 /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/38315b445690f32b4b7a167d106562a8e9bdf246
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a98f13137c6de628babdcea1f0a232f1105432d0
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fb52ae3f65bc8232d0bce8a9b9607713071e06ef
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/26b56188e607bb1e90bc3e5e2d2974ed66fce2de
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c81e9fb918556f862d6d2cbc70c21850d524eee2
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a1622744d71e22c4c8a805f834c3b4c6b9895750
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a9c3e54c1a11d496d0ec9f45bfa5a9676812be23
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ee2f12b5291836db47ea16f68ebc09b99c19241
Nov 02 12:40:48 user nova-compute[74534]: INFO nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e2b5b0136495b41d5d95b20b88620981c7735312
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Verification complete {{(pid=74534) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Verify swap images {{(pid=74534) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 02 12:40:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.imagecache [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Verify ephemeral images {{(pid=74534) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 02 12:40:49 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 is timed out.
Nov 02 12:40:49 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully detached device vdb from instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 from the live domain config.
Nov 02 12:40:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:40:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUbIGZAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:40:49 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:40:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:40:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:40:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbecfc7-ab80-40e6-9e2c-afb3ac62402a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:40:50 user nova-compute[74534]: No targets found.
Nov 02 12:40:50 user nova-compute[74534]: iSNS:
Nov 02 12:40:50 user nova-compute[74534]: No targets found.
Nov 02 12:40:50 user nova-compute[74534]: STATIC:
Nov 02 12:40:50 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487
Nov 02 12:40:50 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:40:50 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:40:50 user nova-compute[74534]: FIRMWARE:
Nov 02 12:40:50 user nova-compute[74534]: No targets found.
Nov 02 12:40:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:40:50 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:40:50 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de40d5d-168a-42cd-bde9-9c38179590b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d968b3-f467-40dd-8a1a-33fcb9c2e88f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 (non-flash)
Nov 02 12:40:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 (non-flash)
Nov 02 12:40:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe198317130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2607166-3f48-4e58-a8ec-e3acd070cf33]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fb79be-c93d-4c3b-af0f-d2de07324473]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[626d4061-f472-43d9-b9f2-92bd164739dc]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf2780a-37ae-4ebf-a1f1-1e9bfdaaa12d]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bfc8b4-3b1d-4524-9039-11c4c8740267]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1c4595-0ab8-4617-8ef3-d404bc686185]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260]
Nov 02 12:40:50 user nova-compute[74534]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487, portal: 172.16.0.220,3260] successful.
Nov 02 12:40:50 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f76b9-5c84-4a9c-9079-00eee2a09f8b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== disconnect_volume: return (277ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:40:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG nova.objects.instance [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'flavor' on Instance uuid c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-30b1d798-7b86-49a7-8d86-2ef8f47a5b34 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.031s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.894s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:51 user nova-compute[74534]: INFO nova.compute.manager [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Terminating instance
Nov 02 12:40:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-0a317cfa-80a6-441d-811f-57c09848f933 req-9e765bad-901d-45fe-979e-f9b4b2418d77 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-vif-unplugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0a317cfa-80a6-441d-811f-57c09848f933 req-9e765bad-901d-45fe-979e-f9b4b2418d77 service nova] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0a317cfa-80a6-441d-811f-57c09848f933 req-9e765bad-901d-45fe-979e-f9b4b2418d77 service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0a317cfa-80a6-441d-811f-57c09848f933 req-9e765bad-901d-45fe-979e-f9b4b2418d77 service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-0a317cfa-80a6-441d-811f-57c09848f933 req-9e765bad-901d-45fe-979e-f9b4b2418d77 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] No waiting events found dispatching network-vif-unplugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:40:51 user nova-compute[74534]: DEBUG nova.compute.manager [req-0a317cfa-80a6-441d-811f-57c09848f933 req-9e765bad-901d-45fe-979e-f9b4b2418d77 service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-vif-unplugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:52 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Instance destroyed successfully.
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lazy-loading 'resources' on Instance uuid c065f4c9-250c-4cac-817f-4ed7ea9b6ca9 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1530462440',display_name='tempest-VolumesSnapshotTestJSON-instance-1530462440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1530462440',id=45,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdml6A5QV6qyjHIZkeGE2LWJAwajLglv5+6jQ7noWfdroZW0xmcHbt9Y5fFoPmgsuAmce/UWZkYfTg7suDEjmcWU3jYl4m54ZhDWzRa08d4HQL2tzBQquEwnlQX9hN/bw==',key_name='tempest-keypair-1746948359',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60125df414f34e7a9cbe85b15fd1808e',ramdisk_id='',reservation_id='r-4utcf7va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1611265569',owner_user_name='tempest-VolumesSnapshotTestJSON-1611265569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28dcfc55e70c43b6ba92dfc1ea4c29ce',uuid=c065f4c9-250c-4cac-817f-4ed7ea9b6ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converting VIF {"id": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "address": "fa:16:3e:90:07:f6", "network": {"id": "7a95acf8-d6b2-4b9b-974c-d17126660126", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1226784670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60125df414f34e7a9cbe85b15fd1808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29cd8641-8c", "ovs_interfaceid": "29cd8641-8c80-4794-a334-14fe4fe1ea22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=29cd8641-8c80-4794-a334-14fe4fe1ea22,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29cd8641-8c') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG os_vif [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=29cd8641-8c80-4794-a334-14fe4fe1ea22,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29cd8641-8c') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29cd8641-8c, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a688bd0-0386-439e-a88e-ea90a5cddd06) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:40:52 user nova-compute[74534]: INFO os_vif [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:07:f6,bridge_name='br-int',has_traffic_filtering=True,id=29cd8641-8c80-4794-a334-14fe4fe1ea22,network=Network(7a95acf8-d6b2-4b9b-974c-d17126660126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29cd8641-8c')
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:bc4bb253-488f-4467-927e-1b78c31a8487', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUbIGZAw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:40:52 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:40:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[23cfb385-c614-4db2-bc0d-982e1a82771f]: Unexpected error while running command.
Nov 02 12:40:52 user nova-compute[74534]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:40:52 user nova-compute[74534]: Exit code: 21
Nov 02 12:40:52 user nova-compute[74534]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:40:52 user nova-compute[74534]: Stderr: '' {{(pid=86346) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 02 12:40:52 user nova-compute[74534]: Traceback (most recent call last):
Nov 02 12:40:52 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 02 12:40:52 user nova-compute[74534]:     ret = func(*f_args, **f_kwargs)
Nov 02 12:40:52 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 02 12:40:52 user nova-compute[74534]:     return func(*args, **kwargs)
Nov 02 12:40:52 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 02 12:40:52 user nova-compute[74534]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 02 12:40:52 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 02 12:40:52 user nova-compute[74534]:     return putils.execute(on_execute=on_execute,
Nov 02 12:40:52 user nova-compute[74534]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 02 12:40:52 user nova-compute[74534]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 02 12:40:52 user nova-compute[74534]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 12:40:52 user nova-compute[74534]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:40:52 user nova-compute[74534]: Exit code: 21
Nov 02 12:40:52 user nova-compute[74534]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:40:52 user nova-compute[74534]: Stderr: ''
Nov 02 12:40:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cfb385-c614-4db2-bc0d-982e1a82771f]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 12:40:52 user nova-compute[74534]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:40:52 user nova-compute[74534]: Exit code: 21
Nov 02 12:40:52 user nova-compute[74534]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:40:52 user nova-compute[74534]: Stderr: ''
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 02 12:40:52 user nova-compute[74534]: ERROR os_brick.initiator.connectors.iscsi 
Nov 02 12:40:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74534) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.024s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] <== disconnect_volume: return (24ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:40:52 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Deleting instance files /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9_del
Nov 02 12:40:52 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Deletion of /opt/stack/data/nova/instances/c065f4c9-250c-4cac-817f-4ed7ea9b6ca9_del complete
Nov 02 12:40:52 user nova-compute[74534]: INFO nova.compute.manager [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 02 12:40:52 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:40:52 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:40:53 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Took 0.93 seconds to deallocate network for instance.
Nov 02 12:40:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-94293c2e-0020-4011-884b-444cbb8da288 req-e4b1a405-16b3-4bbc-b7c9-f7d0bb25ee2d service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-vif-deleted-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:40:53 user nova-compute[74534]: WARNING nova.volume.cinder [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Attachment 6aa101bc-5606-4158-9d60-6ee5c91421a6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6aa101bc-5606-4158-9d60-6ee5c91421a6. (HTTP 404) (Request-ID: req-113c4cca-b2bc-4fab-ac46-3f6a50a53c64)
Nov 02 12:40:53 user nova-compute[74534]: INFO nova.compute.manager [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Took 0.03 seconds to detach 1 volumes for instance.
Nov 02 12:40:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:53 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Deleted allocations for instance c065f4c9-250c-4cac-817f-4ed7ea9b6ca9
Nov 02 12:40:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-27c60343-da23-4049-8e83-5a6f2452f792 tempest-VolumesSnapshotTestJSON-1611265569 tempest-VolumesSnapshotTestJSON-1611265569-project-member] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-d87f51df-0331-4d3b-8bd3-94a7fa91d507 req-2fd32ce5-11c1-4ddb-afa3-6de072710afa service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received event network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d87f51df-0331-4d3b-8bd3-94a7fa91d507 req-2fd32ce5-11c1-4ddb-afa3-6de072710afa service nova] Acquiring lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d87f51df-0331-4d3b-8bd3-94a7fa91d507 req-2fd32ce5-11c1-4ddb-afa3-6de072710afa service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d87f51df-0331-4d3b-8bd3-94a7fa91d507 req-2fd32ce5-11c1-4ddb-afa3-6de072710afa service nova] Lock "c065f4c9-250c-4cac-817f-4ed7ea9b6ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:40:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-d87f51df-0331-4d3b-8bd3-94a7fa91d507 req-2fd32ce5-11c1-4ddb-afa3-6de072710afa service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] No waiting events found dispatching network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:40:53 user nova-compute[74534]: WARNING nova.compute.manager [req-d87f51df-0331-4d3b-8bd3-94a7fa91d507 req-2fd32ce5-11c1-4ddb-afa3-6de072710afa service nova] [instance: c065f4c9-250c-4cac-817f-4ed7ea9b6ca9] Received unexpected event network-vif-plugged-29cd8641-8c80-4794-a334-14fe4fe1ea22 for instance with vm_state deleted and task_state None.
Nov 02 12:40:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:41:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:41:20 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:41:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:41:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:41:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:41:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:41:26 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:41:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9081MB free_disk=25.011348724365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:41:26 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:41:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:41:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:41:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:41:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:41:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:41:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:41:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:41:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:41:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:42:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:42:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:42:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:42:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:42:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:42:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:42:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:42:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:42:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:21 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:42:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:23 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:42:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:42:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:27 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:42:27 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=25.00946044921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:42:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:42:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:42:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:42:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:42:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:42:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:42:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:42:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:42:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:43:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:43:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:43:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:43:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:43:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:43:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:43:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:26 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:43:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:43:26 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:43:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:43:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:43:29 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:43:29 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=24.999435424804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:43:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:43:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:43:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:43:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:43:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:44:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:44:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:44:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:44:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "223848f0-cb5b-4717-92fa-45c10b86ed09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:44:06 user nova-compute[74534]: INFO nova.compute.claims [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Claim successful on node user
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.network.neutron [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:44:06 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:44:06 user nova-compute[74534]: INFO nova.virt.block_device [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Booting with volume snapshot ec74eb11-9d8a-4a2f-b466-7dd5abd70b9e at /dev/vda
Nov 02 12:44:06 user nova-compute[74534]: DEBUG nova.policy [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6f47ffa03e4eb1a8e70de2b66a47b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892f774d6074fc1b0eb752e802efb5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:44:07 user nova-compute[74534]: DEBUG nova.network.neutron [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Successfully created port: 5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:44:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Successfully updated port: 5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquired lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received event network-changed-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Refreshing instance network info cache due to event network-changed-5f24a90b-1d58-42ec-a5e8-75953ed0780b. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] Acquiring lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.network.neutron [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updating instance_info_cache with network_info: [{"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Releasing lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Instance network_info: |[{"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] Acquired lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.network.neutron [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Refreshing network info cache for port 5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.network.neutron [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updated VIF entry in instance network info cache for port 5f24a90b-1d58-42ec-a5e8-75953ed0780b. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG nova.network.neutron [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updating instance_info_cache with network_info: [{"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:44:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f3875dc8-d9b1-49d3-928b-e4fbff6ce38d req-afbc1bb2-880e-450a-a752-9bd3d2ce7937 service nova] Releasing lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:44:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG os_brick.utils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bf08a2-61f7-474d-9bb3-eb293a82bc97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5be09-f1cd-4dfe-8db6-5097da6430c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c12079-96c1-481a-92f6-0e870ae9bfaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[de44fcad-231d-4b05-a859-251e03afcd36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:44:12 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:44:12 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d81f31-0b0a-49d1-aa9f-86895a89ef43]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG os_brick.utils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updating existing volume attachment record: f0ab6405-8ec1-40ad-9ac4-338ef1f62a56 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:44:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:44:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:44:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:44:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:44:28 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:44:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:44:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:44:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:44:31 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:44:31 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9074MB free_disk=24.996631622314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 223848f0-cb5b-4717-92fa-45c10b86ed09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:44:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:44:32 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Creating image(s)
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Ensure instance console log exists: /opt/stack/data/nova/instances/223848f0-cb5b-4717-92fa-45c10b86ed09/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Start _get_guest_xml network_info=[{"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'f0ab6405-8ec1-40ad-9ac4-338ef1f62a56', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtWdROlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '223848f0-cb5b-4717-92fa-45c10b86ed09', 'attached_at': '', 'detached_at': '', 'volume_id': '6beaf52b-e7eb-4f4d-99c4-2f89ac14195c', 'serial': '6beaf52b-e7eb-4f4d-99c4-2f89ac14195c'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:44:32 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:44:32 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtWdROlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:44:32 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:44:32 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:44:32 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2481741-2987-4d87-bab1-47d6ae5e705e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:44:32 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad0355-40a3-4f7d-9857-c8d6cfbcb59f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c] added
Nov 02 12:44:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d6c75-3f0a-4aa1-9ad3-d318602ce705]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d64392-175d-42b1-a7fe-eef87b16b325]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtWdROlq {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtWdROlq" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1052e0ee-2454-4a10-ab2b-0e3fd9a24e9d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtWdROlq'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[222442aa-62f1-4e8a-aca8-ef17061251cb]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ab9f3-eac7-4040-82d1-e12abb7bbb8f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:44:32 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:44:32 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:44:32 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:44:32 user nova-compute[74534]: 
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e106d37-7140-48bc-a2df-a042ff3a0a44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260]
Nov 02 12:44:32 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260] successful.
Nov 02 12:44:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2e1b6-4eb9-4137-bb2a-3cf3bdaacf7b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[159a41b7-0cfe-4f73-ac13-32ee4daf75d8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c (non-flash)
Nov 02 12:44:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c (non-flash)
Nov 02 12:44:32 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdd6b8d-dfe9-42e1-8a62-5c020065208e]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtWdROlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:44:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23834613431323665', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834613431323665', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-629734156',display_name='tempest-TestVolumeBootPattern-server-629734156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-629734156',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-9vokkg5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:44:07Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=223848f0-cb5b-4717-92fa-45c10b86ed09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:94:50,bridge_name='br-int',has_traffic_filtering=True,id=5f24a90b-1d58-42ec-a5e8-75953ed0780b,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f24a90b-1d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.objects.instance [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'pci_devices' on Instance uuid 223848f0-cb5b-4717-92fa-45c10b86ed09 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:44:33 user nova-compute[74534]:   <uuid>223848f0-cb5b-4717-92fa-45c10b86ed09</uuid>
Nov 02 12:44:33 user nova-compute[74534]:   <name>instance-0000002e</name>
Nov 02 12:44:33 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:44:33 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:44:33 user nova-compute[74534]:   <metadata>
Nov 02 12:44:33 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:44:33 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:44:33 user nova-compute[74534]:       <nova:name>tempest-TestVolumeBootPattern-server-629734156</nova:name>
Nov 02 12:44:33 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:44:32</nova:creationTime>
Nov 02 12:44:33 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:44:33 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:44:33 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:44:33 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:44:33 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:44:33 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:44:33 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:44:33 user nova-compute[74534]:       <nova:owner>
Nov 02 12:44:33 user nova-compute[74534]:         <nova:user uuid="0c6f47ffa03e4eb1a8e70de2b66a47b6">tempest-TestVolumeBootPattern-1985560946-project-member</nova:user>
Nov 02 12:44:33 user nova-compute[74534]:         <nova:project uuid="a892f774d6074fc1b0eb752e802efb5b">tempest-TestVolumeBootPattern-1985560946</nova:project>
Nov 02 12:44:33 user nova-compute[74534]:       </nova:owner>
Nov 02 12:44:33 user nova-compute[74534]:       <nova:ports>
Nov 02 12:44:33 user nova-compute[74534]:         <nova:port uuid="5f24a90b-1d58-42ec-a5e8-75953ed0780b">
Nov 02 12:44:33 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 12:44:33 user nova-compute[74534]:         </nova:port>
Nov 02 12:44:33 user nova-compute[74534]:       </nova:ports>
Nov 02 12:44:33 user nova-compute[74534]:     </nova:instance>
Nov 02 12:44:33 user nova-compute[74534]:   </metadata>
Nov 02 12:44:33 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:44:33 user nova-compute[74534]:     <system>
Nov 02 12:44:33 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:44:33 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:44:33 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:44:33 user nova-compute[74534]:       <entry name="serial">223848f0-cb5b-4717-92fa-45c10b86ed09</entry>
Nov 02 12:44:33 user nova-compute[74534]:       <entry name="uuid">223848f0-cb5b-4717-92fa-45c10b86ed09</entry>
Nov 02 12:44:33 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:44:33 user nova-compute[74534]:     </system>
Nov 02 12:44:33 user nova-compute[74534]:   </sysinfo>
Nov 02 12:44:33 user nova-compute[74534]:   <os>
Nov 02 12:44:33 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:44:33 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:44:33 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:44:33 user nova-compute[74534]:   </os>
Nov 02 12:44:33 user nova-compute[74534]:   <features>
Nov 02 12:44:33 user nova-compute[74534]:     <acpi/>
Nov 02 12:44:33 user nova-compute[74534]:     <apic/>
Nov 02 12:44:33 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:44:33 user nova-compute[74534]:   </features>
Nov 02 12:44:33 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:44:33 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:44:33 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:44:33 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:44:33 user nova-compute[74534]:   </clock>
Nov 02 12:44:33 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:44:33 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:44:33 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:44:33 user nova-compute[74534]:   </cpu>
Nov 02 12:44:33 user nova-compute[74534]:   <devices>
Nov 02 12:44:33 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:44:33 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:44:33 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:44:33 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:44:33 user nova-compute[74534]:       <serial>6beaf52b-e7eb-4f4d-99c4-2f89ac14195c</serial>
Nov 02 12:44:33 user nova-compute[74534]:     </disk>
Nov 02 12:44:33 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:44:33 user nova-compute[74534]:       <mac address="fa:16:3e:f9:94:50"/>
Nov 02 12:44:33 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:44:33 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:44:33 user nova-compute[74534]:       <target dev="tap5f24a90b-1d"/>
Nov 02 12:44:33 user nova-compute[74534]:     </interface>
Nov 02 12:44:33 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:44:33 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/223848f0-cb5b-4717-92fa-45c10b86ed09/console.log" append="off"/>
Nov 02 12:44:33 user nova-compute[74534]:     </serial>
Nov 02 12:44:33 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:44:33 user nova-compute[74534]:     <video>
Nov 02 12:44:33 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:44:33 user nova-compute[74534]:     </video>
Nov 02 12:44:33 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:44:33 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:44:33 user nova-compute[74534]:     </rng>
Nov 02 12:44:33 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:44:33 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:44:33 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:44:33 user nova-compute[74534]:     </memballoon>
Nov 02 12:44:33 user nova-compute[74534]:   </devices>
Nov 02 12:44:33 user nova-compute[74534]: </domain>
Nov 02 12:44:33 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-629734156',display_name='tempest-TestVolumeBootPattern-server-629734156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-629734156',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-9vokkg5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:44:07Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=223848f0-cb5b-4717-92fa-45c10b86ed09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:94:50,bridge_name='br-int',has_traffic_filtering=True,id=5f24a90b-1d58-42ec-a5e8-75953ed0780b,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f24a90b-1d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG os_vif [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:94:50,bridge_name='br-int',has_traffic_filtering=True,id=5f24a90b-1d58-42ec-a5e8-75953ed0780b,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f24a90b-1d') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48fdb4df-5993-5f01-85ac-506cea8cd17e', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f24a90b-1d, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f24a90b-1d, col_values=(('qos', UUID('d189b757-895a-4f3c-8b18-b77832d5ee9c')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f24a90b-1d, col_values=(('external_ids', {'iface-id': '5f24a90b-1d58-42ec-a5e8-75953ed0780b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:94:50', 'vm-uuid': '223848f0-cb5b-4717-92fa-45c10b86ed09'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:33 user nova-compute[74534]: INFO os_vif [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:94:50,bridge_name='br-int',has_traffic_filtering=True,id=5f24a90b-1d58-42ec-a5e8-75953ed0780b,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f24a90b-1d')
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:44:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No VIF found with MAC fa:16:3e:f9:94:50, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:44:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-3402bb77-b959-4a88-b63a-ba08cb7425e0 req-cf30fccd-66fa-47d6-a020-6de52fceb999 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received event network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3402bb77-b959-4a88-b63a-ba08cb7425e0 req-cf30fccd-66fa-47d6-a020-6de52fceb999 service nova] Acquiring lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3402bb77-b959-4a88-b63a-ba08cb7425e0 req-cf30fccd-66fa-47d6-a020-6de52fceb999 service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3402bb77-b959-4a88-b63a-ba08cb7425e0 req-cf30fccd-66fa-47d6-a020-6de52fceb999 service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-3402bb77-b959-4a88-b63a-ba08cb7425e0 req-cf30fccd-66fa-47d6-a020-6de52fceb999 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] No waiting events found dispatching network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:44:35 user nova-compute[74534]: WARNING nova.compute.manager [req-3402bb77-b959-4a88-b63a-ba08cb7425e0 req-cf30fccd-66fa-47d6-a020-6de52fceb999 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received unexpected event network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b for instance with vm_state building and task_state spawning.
Nov 02 12:44:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:44:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Instance spawned successfully.
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:44:37 user nova-compute[74534]: INFO nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:44:37 user nova-compute[74534]: INFO nova.compute.manager [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Took 30.93 seconds to build instance.
Nov 02 12:44:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cfceed5d-588c-4a38-80be-274665d7b0c0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.026s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-9216b56d-f9d3-48c3-9181-259ef8eb72f0 req-2a3fe92d-7540-49bb-892d-82ce94a93e96 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received event network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9216b56d-f9d3-48c3-9181-259ef8eb72f0 req-2a3fe92d-7540-49bb-892d-82ce94a93e96 service nova] Acquiring lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9216b56d-f9d3-48c3-9181-259ef8eb72f0 req-2a3fe92d-7540-49bb-892d-82ce94a93e96 service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9216b56d-f9d3-48c3-9181-259ef8eb72f0 req-2a3fe92d-7540-49bb-892d-82ce94a93e96 service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:44:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-9216b56d-f9d3-48c3-9181-259ef8eb72f0 req-2a3fe92d-7540-49bb-892d-82ce94a93e96 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] No waiting events found dispatching network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:44:37 user nova-compute[74534]: WARNING nova.compute.manager [req-9216b56d-f9d3-48c3-9181-259ef8eb72f0 req-2a3fe92d-7540-49bb-892d-82ce94a93e96 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received unexpected event network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b for instance with vm_state active and task_state None.
Nov 02 12:44:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:44:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:44:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:45:22 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:45:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:26 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:26 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 223848f0-cb5b-4717-92fa-45c10b86ed09 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updating instance_info_cache with network_info: [{"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-223848f0-cb5b-4717-92fa-45c10b86ed09" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:45:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:45:33 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:45:33 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=24.954368591308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 223848f0-cb5b-4717-92fa-45c10b86ed09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:45:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:45:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:45:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "223848f0-cb5b-4717-92fa-45c10b86ed09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:45:56 user nova-compute[74534]: INFO nova.compute.manager [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Terminating instance
Nov 02 12:45:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-6cbb44dc-412b-451e-b6fd-491fad5f1404 req-e0693850-d0cd-4e0c-9929-3cdb20ce1f4d service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received event network-vif-unplugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cbb44dc-412b-451e-b6fd-491fad5f1404 req-e0693850-d0cd-4e0c-9929-3cdb20ce1f4d service nova] Acquiring lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cbb44dc-412b-451e-b6fd-491fad5f1404 req-e0693850-d0cd-4e0c-9929-3cdb20ce1f4d service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-6cbb44dc-412b-451e-b6fd-491fad5f1404 req-e0693850-d0cd-4e0c-9929-3cdb20ce1f4d service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-6cbb44dc-412b-451e-b6fd-491fad5f1404 req-e0693850-d0cd-4e0c-9929-3cdb20ce1f4d service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] No waiting events found dispatching network-vif-unplugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:45:56 user nova-compute[74534]: DEBUG nova.compute.manager [req-6cbb44dc-412b-451e-b6fd-491fad5f1404 req-e0693850-d0cd-4e0c-9929-3cdb20ce1f4d service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received event network-vif-unplugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Instance destroyed successfully.
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.objects.instance [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'resources' on Instance uuid 223848f0-cb5b-4717-92fa-45c10b86ed09 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-629734156',display_name='tempest-TestVolumeBootPattern-server-629734156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-629734156',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-9vokkg5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:44:37Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=223848f0-cb5b-4717-92fa-45c10b86ed09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "address": "fa:16:3e:f9:94:50", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f24a90b-1d", "ovs_interfaceid": "5f24a90b-1d58-42ec-a5e8-75953ed0780b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:94:50,bridge_name='br-int',has_traffic_filtering=True,id=5f24a90b-1d58-42ec-a5e8-75953ed0780b,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f24a90b-1d') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_vif [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:94:50,bridge_name='br-int',has_traffic_filtering=True,id=5f24a90b-1d58-42ec-a5e8-75953ed0780b,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f24a90b-1d') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f24a90b-1d, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d189b757-895a-4f3c-8b18-b77832d5ee9c) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:45:57 user nova-compute[74534]: INFO os_vif [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:94:50,bridge_name='br-int',has_traffic_filtering=True,id=5f24a90b-1d58-42ec-a5e8-75953ed0780b,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f24a90b-1d')
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtWdROlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:45:57 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a3738d-f585-41e3-ba5d-62a651c6e7ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:45:57 user nova-compute[74534]: No targets found.
Nov 02 12:45:57 user nova-compute[74534]: iSNS:
Nov 02 12:45:57 user nova-compute[74534]: No targets found.
Nov 02 12:45:57 user nova-compute[74534]: STATIC:
Nov 02 12:45:57 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c
Nov 02 12:45:57 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:45:57 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:45:57 user nova-compute[74534]: FIRMWARE:
Nov 02 12:45:57 user nova-compute[74534]: No targets found.
Nov 02 12:45:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:45:57 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:45:57 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27ee09-9455-4951-9852-016d1dd3a6df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05215ca-d5a1-489c-8e6a-e6db64134f23]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c (non-flash)
Nov 02 12:45:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c (non-flash)
Nov 02 12:45:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180667e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[91274d82-faf7-4be8-8729-022aae0cd490]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a82bd55-e657-4b9f-b1a0-aa78d79c89d2]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[91701836-37fa-4db3-b9f8-26c5363b3035]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da4832-e2da-40bf-a5ae-128156c19bd1]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bad411-a4b3-413a-90b9-f7ce8faf335d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b94b34-c67b-4789-88ff-ed61cb5c7fc2]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260]
Nov 02 12:45:57 user nova-compute[74534]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c, portal: 172.16.0.220,3260] successful.
Nov 02 12:45:57 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6beaf52b-e7eb-4f4d-99c4-2f89ac14195c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6496f3-cc19-48e3-a459-52623e691ecc]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== disconnect_volume: return (305ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:45:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Deleting instance files /opt/stack/data/nova/instances/223848f0-cb5b-4717-92fa-45c10b86ed09_del
Nov 02 12:45:57 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Deletion of /opt/stack/data/nova/instances/223848f0-cb5b-4717-92fa-45c10b86ed09_del complete
Nov 02 12:45:57 user nova-compute[74534]: INFO nova.compute.manager [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 02 12:45:57 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:45:57 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:45:58 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:45:58 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Took 0.65 seconds to deallocate network for instance.
Nov 02 12:45:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-cacbf14b-ceef-4733-a95b-38317a3ea641 req-1828d8a7-ecf6-4322-ab08-d74a407444a5 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received event network-vif-deleted-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:45:58 user nova-compute[74534]: INFO nova.compute.manager [req-cacbf14b-ceef-4733-a95b-38317a3ea641 req-1828d8a7-ecf6-4322-ab08-d74a407444a5 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Neutron deleted interface 5f24a90b-1d58-42ec-a5e8-75953ed0780b; detaching it from the instance and deleting it from the info cache
Nov 02 12:45:58 user nova-compute[74534]: DEBUG nova.network.neutron [req-cacbf14b-ceef-4733-a95b-38317a3ea641 req-1828d8a7-ecf6-4322-ab08-d74a407444a5 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:45:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-cacbf14b-ceef-4733-a95b-38317a3ea641 req-1828d8a7-ecf6-4322-ab08-d74a407444a5 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Detach interface failed, port_id=5f24a90b-1d58-42ec-a5e8-75953ed0780b, reason: Instance 223848f0-cb5b-4717-92fa-45c10b86ed09 could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 12:45:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-07176a2a-6e55-4660-a338-73baac927877 req-0ed2af48-2170-4a2c-ac9b-2bdcc2cbbca3 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received event network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:45:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07176a2a-6e55-4660-a338-73baac927877 req-0ed2af48-2170-4a2c-ac9b-2bdcc2cbbca3 service nova] Acquiring lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:45:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07176a2a-6e55-4660-a338-73baac927877 req-0ed2af48-2170-4a2c-ac9b-2bdcc2cbbca3 service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:45:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-07176a2a-6e55-4660-a338-73baac927877 req-0ed2af48-2170-4a2c-ac9b-2bdcc2cbbca3 service nova] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:45:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-07176a2a-6e55-4660-a338-73baac927877 req-0ed2af48-2170-4a2c-ac9b-2bdcc2cbbca3 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] No waiting events found dispatching network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:45:58 user nova-compute[74534]: WARNING nova.compute.manager [req-07176a2a-6e55-4660-a338-73baac927877 req-0ed2af48-2170-4a2c-ac9b-2bdcc2cbbca3 service nova] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Received unexpected event network-vif-plugged-5f24a90b-1d58-42ec-a5e8-75953ed0780b for instance with vm_state active and task_state deleting.
Nov 02 12:45:59 user nova-compute[74534]: INFO nova.compute.manager [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Took 0.88 seconds to detach 1 volumes for instance.
Nov 02 12:45:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 223848f0-cb5b-4717-92fa-45c10b86ed09] Deleting volume: 6beaf52b-e7eb-4f4d-99c4-2f89ac14195c {{(pid=74534) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 12:45:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:45:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:45:59 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:45:59 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:45:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:45:59 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Deleted allocations for instance 223848f0-cb5b-4717-92fa-45c10b86ed09
Nov 02 12:45:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-08d1fdf4-025e-4f9f-affb-78fa5140c547 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "223848f0-cb5b-4717-92fa-45c10b86ed09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.099s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:46:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:20 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:46:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:46:27 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:28 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:46:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:46:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:46:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:46:34 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:46:34 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:46:34 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9081MB free_disk=24.952991485595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:46:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:46:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:46:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:46:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:46:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:46:56 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:46:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:47:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:12 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:47:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:47:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "2dc1f465-2991-4ca1-b155-c83056e7a786" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:47:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:47:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:47:28 user nova-compute[74534]: INFO nova.compute.claims [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Claim successful on node user
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.network.neutron [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:47:28 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG nova.policy [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6f47ffa03e4eb1a8e70de2b66a47b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892f774d6074fc1b0eb752e802efb5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:47:28 user nova-compute[74534]: INFO nova.virt.block_device [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Booting with volume beee5c8f-dbaf-4a74-bc56-6931274a8579 at /dev/vda
Nov 02 12:47:28 user nova-compute[74534]: DEBUG os_brick.utils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769da0c-ba02-4a8c-89f8-0e1b897b463f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e9a68c-51d8-477d-9978-1bfdd962a12d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4436f4d-9756-4897-859f-4b90783de95b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebf28b5-dbd2-4fb4-b7ad-64833aa32f32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:28 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:47:29 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:47:29 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d41472c-2e35-486b-9406-4ddcd4568b75]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG os_brick.utils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating existing volume attachment record: ef216fd3-e283-4b12-a2be-54d86d159ad9 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:29 user nova-compute[74534]: DEBUG nova.network.neutron [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Successfully created port: 0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG nova.network.neutron [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Successfully updated port: 0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquired lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG nova.network.neutron [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-changed-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Refreshing instance network info cache due to event network-changed-0972289d-b5b6-49c5-bb79-57064440ca15. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] Acquiring lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG nova.network.neutron [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:47:30 user nova-compute[74534]: DEBUG nova.network.neutron [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating instance_info_cache with network_info: [{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Releasing lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Instance network_info: |[{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] Acquired lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Refreshing network info cache for port 0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updated VIF entry in instance network info cache for port 0972289d-b5b6-49c5-bb79-57064440ca15. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG nova.network.neutron [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating instance_info_cache with network_info: [{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:47:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-902dee87-45f5-4382-ace1-6b6f0630e47f req-b885a0f7-8f87-43f8-9b76-ad4ea6d90b38 service nova] Releasing lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:47:32 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:47:35 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:47:35 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=24.942981719970703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2dc1f465-2991-4ca1-b155-c83056e7a786 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:47:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:47:37 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:47 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:47:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Creating image(s)
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Ensure instance console log exists: /opt/stack/data/nova/instances/2dc1f465-2991-4ca1-b155-c83056e7a786/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Start _get_guest_xml network_info=[{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'ef216fd3-e283-4b12-a2be-54d86d159ad9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIzvsWwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2dc1f465-2991-4ca1-b155-c83056e7a786', 'attached_at': '', 'detached_at': '', 'volume_id': 'beee5c8f-dbaf-4a74-bc56-6931274a8579', 'serial': 'beee5c8f-dbaf-4a74-bc56-6931274a8579'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:47:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:47:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIzvsWwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:47:54 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:47:54 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:47:54 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a192acbb-cc11-4e18-9614-02ade4a01234]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:47:54 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f973ec0-2b0b-48b3-8097-517067e3312b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579] added
Nov 02 12:47:54 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53cea99-9e0f-45a0-aa4e-0ebe7a908f2f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c017c3f-1600-424a-8389-f169ae5e148e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIzvsWwS {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIzvsWwS" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2bcc3e-82aa-4a72-94cf-ec2ba24d290c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UIzvsWwS'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f07b062-f465-41bf-8f5b-458bc7067584]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:54 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca86d46-57fb-482a-a55b-055cc4caa982]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:47:55 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:47:55 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:47:55 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:47:55 user nova-compute[74534]: 
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da65aaf-7ee5-42ad-8d7a-2a7150a0ebd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260]
Nov 02 12:47:55 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260] successful.
Nov 02 12:47:55 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0152fa7-040a-45b1-8b79-a8064d38035e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[79978c0d-d889-4753-be85-d9b8d68547fa]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:47:55 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:47:55 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b1fae3-2b92-46fd-bc15-62864414b1dc]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:47:55 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIzvsWwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23161663839366164', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161663839366164', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-916313530',display_name='tempest-TestVolumeBootPattern-volume-backed-server-916313530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-916313530',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwAKIJVJ2yQdwVMwQpvM9IvMHdh+sOXCggGua7Kl9/KcooWp4tOyHN1aVrMvM2fWs4dIuPHYrqhx89rvkXakDXG2JX08Arzg3DKHEBLHoS8o53LDeFV8sCr+Z6Rjh8s3w==',key_name='tempest-keypair-1741581975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-7ea0rgm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=2dc1f465-2991-4ca1-b155-c83056e7a786,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0972289d-b5b6-49c5-bb79-57064440ca15,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0972289d-b5') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dc1f465-2991-4ca1-b155-c83056e7a786 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:47:56 user nova-compute[74534]:   <uuid>2dc1f465-2991-4ca1-b155-c83056e7a786</uuid>
Nov 02 12:47:56 user nova-compute[74534]:   <name>instance-0000002f</name>
Nov 02 12:47:56 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:47:56 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:47:56 user nova-compute[74534]:   <metadata>
Nov 02 12:47:56 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:47:56 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:47:56 user nova-compute[74534]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-916313530</nova:name>
Nov 02 12:47:56 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:47:54</nova:creationTime>
Nov 02 12:47:56 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:47:56 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:47:56 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:47:56 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:47:56 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:47:56 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:47:56 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:47:56 user nova-compute[74534]:       <nova:owner>
Nov 02 12:47:56 user nova-compute[74534]:         <nova:user uuid="0c6f47ffa03e4eb1a8e70de2b66a47b6">tempest-TestVolumeBootPattern-1985560946-project-member</nova:user>
Nov 02 12:47:56 user nova-compute[74534]:         <nova:project uuid="a892f774d6074fc1b0eb752e802efb5b">tempest-TestVolumeBootPattern-1985560946</nova:project>
Nov 02 12:47:56 user nova-compute[74534]:       </nova:owner>
Nov 02 12:47:56 user nova-compute[74534]:       <nova:ports>
Nov 02 12:47:56 user nova-compute[74534]:         <nova:port uuid="0972289d-b5b6-49c5-bb79-57064440ca15">
Nov 02 12:47:56 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 12:47:56 user nova-compute[74534]:         </nova:port>
Nov 02 12:47:56 user nova-compute[74534]:       </nova:ports>
Nov 02 12:47:56 user nova-compute[74534]:     </nova:instance>
Nov 02 12:47:56 user nova-compute[74534]:   </metadata>
Nov 02 12:47:56 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:47:56 user nova-compute[74534]:     <system>
Nov 02 12:47:56 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:47:56 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:47:56 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:47:56 user nova-compute[74534]:       <entry name="serial">2dc1f465-2991-4ca1-b155-c83056e7a786</entry>
Nov 02 12:47:56 user nova-compute[74534]:       <entry name="uuid">2dc1f465-2991-4ca1-b155-c83056e7a786</entry>
Nov 02 12:47:56 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:47:56 user nova-compute[74534]:     </system>
Nov 02 12:47:56 user nova-compute[74534]:   </sysinfo>
Nov 02 12:47:56 user nova-compute[74534]:   <os>
Nov 02 12:47:56 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:47:56 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:47:56 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:47:56 user nova-compute[74534]:   </os>
Nov 02 12:47:56 user nova-compute[74534]:   <features>
Nov 02 12:47:56 user nova-compute[74534]:     <acpi/>
Nov 02 12:47:56 user nova-compute[74534]:     <apic/>
Nov 02 12:47:56 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:47:56 user nova-compute[74534]:   </features>
Nov 02 12:47:56 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:47:56 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:47:56 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:47:56 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:47:56 user nova-compute[74534]:   </clock>
Nov 02 12:47:56 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:47:56 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:47:56 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:47:56 user nova-compute[74534]:   </cpu>
Nov 02 12:47:56 user nova-compute[74534]:   <devices>
Nov 02 12:47:56 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:47:56 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:47:56 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:47:56 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:47:56 user nova-compute[74534]:       <serial>beee5c8f-dbaf-4a74-bc56-6931274a8579</serial>
Nov 02 12:47:56 user nova-compute[74534]:     </disk>
Nov 02 12:47:56 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:47:56 user nova-compute[74534]:       <mac address="fa:16:3e:40:a0:e7"/>
Nov 02 12:47:56 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:47:56 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:47:56 user nova-compute[74534]:       <target dev="tap0972289d-b5"/>
Nov 02 12:47:56 user nova-compute[74534]:     </interface>
Nov 02 12:47:56 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:47:56 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/2dc1f465-2991-4ca1-b155-c83056e7a786/console.log" append="off"/>
Nov 02 12:47:56 user nova-compute[74534]:     </serial>
Nov 02 12:47:56 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:47:56 user nova-compute[74534]:     <video>
Nov 02 12:47:56 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:47:56 user nova-compute[74534]:     </video>
Nov 02 12:47:56 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:47:56 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:47:56 user nova-compute[74534]:     </rng>
Nov 02 12:47:56 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:47:56 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:47:56 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:47:56 user nova-compute[74534]:     </memballoon>
Nov 02 12:47:56 user nova-compute[74534]:   </devices>
Nov 02 12:47:56 user nova-compute[74534]: </domain>
Nov 02 12:47:56 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-916313530',display_name='tempest-TestVolumeBootPattern-volume-backed-server-916313530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-916313530',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwAKIJVJ2yQdwVMwQpvM9IvMHdh+sOXCggGua7Kl9/KcooWp4tOyHN1aVrMvM2fWs4dIuPHYrqhx89rvkXakDXG2JX08Arzg3DKHEBLHoS8o53LDeFV8sCr+Z6Rjh8s3w==',key_name='tempest-keypair-1741581975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-7ea0rgm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=2dc1f465-2991-4ca1-b155-c83056e7a786,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0972289d-b5b6-49c5-bb79-57064440ca15,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0972289d-b5') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG os_vif [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0972289d-b5b6-49c5-bb79-57064440ca15,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0972289d-b5') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31e54b66-47f8-5975-9dd2-f94fd2dd7366', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0972289d-b5, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0972289d-b5, col_values=(('qos', UUID('b06b95b9-3f64-46c1-8dc5-1f404a486bdf')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0972289d-b5, col_values=(('external_ids', {'iface-id': '0972289d-b5b6-49c5-bb79-57064440ca15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:a0:e7', 'vm-uuid': '2dc1f465-2991-4ca1-b155-c83056e7a786'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:56 user nova-compute[74534]: INFO os_vif [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0972289d-b5b6-49c5-bb79-57064440ca15,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0972289d-b5')
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:47:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No VIF found with MAC fa:16:3e:40:a0:e7, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-42ea93c1-4a40-4f4c-aa9a-a146b6e54547 req-4e0b4369-90ba-4e16-8343-b65f68bfc66b service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-42ea93c1-4a40-4f4c-aa9a-a146b6e54547 req-4e0b4369-90ba-4e16-8343-b65f68bfc66b service nova] Acquiring lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-42ea93c1-4a40-4f4c-aa9a-a146b6e54547 req-4e0b4369-90ba-4e16-8343-b65f68bfc66b service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-42ea93c1-4a40-4f4c-aa9a-a146b6e54547 req-4e0b4369-90ba-4e16-8343-b65f68bfc66b service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:47:57 user nova-compute[74534]: DEBUG nova.compute.manager [req-42ea93c1-4a40-4f4c-aa9a-a146b6e54547 req-4e0b4369-90ba-4e16-8343-b65f68bfc66b service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] No waiting events found dispatching network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:47:57 user nova-compute[74534]: WARNING nova.compute.manager [req-42ea93c1-4a40-4f4c-aa9a-a146b6e54547 req-4e0b4369-90ba-4e16-8343-b65f68bfc66b service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received unexpected event network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 for instance with vm_state building and task_state spawning.
Nov 02 12:47:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-3f23066e-5442-4647-ad67-dca0fef5ec5c req-8377bafd-acca-4661-b4d2-17551f669dcc service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3f23066e-5442-4647-ad67-dca0fef5ec5c req-8377bafd-acca-4661-b4d2-17551f669dcc service nova] Acquiring lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3f23066e-5442-4647-ad67-dca0fef5ec5c req-8377bafd-acca-4661-b4d2-17551f669dcc service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3f23066e-5442-4647-ad67-dca0fef5ec5c req-8377bafd-acca-4661-b4d2-17551f669dcc service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.compute.manager [req-3f23066e-5442-4647-ad67-dca0fef5ec5c req-8377bafd-acca-4661-b4d2-17551f669dcc service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] No waiting events found dispatching network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:47:59 user nova-compute[74534]: WARNING nova.compute.manager [req-3f23066e-5442-4647-ad67-dca0fef5ec5c req-8377bafd-acca-4661-b4d2-17551f669dcc service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received unexpected event network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 for instance with vm_state building and task_state spawning.
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:47:59 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Instance spawned successfully.
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:47:59 user nova-compute[74534]: INFO nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 02 12:47:59 user nova-compute[74534]: DEBUG nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:47:59 user nova-compute[74534]: INFO nova.compute.manager [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Took 31.96 seconds to build instance.
Nov 02 12:47:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-28a67504-b93f-4292-aee2-69055a8e3fc5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.070s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:48:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:25 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:48:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 2dc1f465-2991-4ca1-b155-c83056e7a786 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating instance_info_cache with network_info: [{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:48:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:48:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:48:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:48:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:48:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:48:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:48:37 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:48:37 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.94110870361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2dc1f465-2991-4ca1-b155-c83056e7a786 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:48:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:48:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:48:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:48:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:48:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:49:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:49:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:49:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-changed-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG nova.compute.manager [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Refreshing instance network info cache due to event network-changed-0972289d-b5b6-49c5-bb79-57064440ca15. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] Acquiring lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] Acquired lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Refreshing network info cache for port 0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updated VIF entry in instance network info cache for port 0972289d-b5b6-49c5-bb79-57064440ca15. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG nova.network.neutron [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating instance_info_cache with network_info: [{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:49:19 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-293bf9f9-8521-4a8a-b36e-b734b98bd52a req-5b4c84a5-67e8-46bd-acb8-04d9c315207f service nova] Releasing lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:49:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:27 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:49:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "6b9a1921-f7d4-4ff1-9131-fefc45313518" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:49:33 user nova-compute[74534]: INFO nova.compute.claims [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Claim successful on node user
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:49:33 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.network.neutron [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:49:33 user nova-compute[74534]: INFO nova.virt.block_device [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Booting with volume snapshot 02e39827-179e-4a77-8340-cd2332516b65 at /dev/vda
Nov 02 12:49:33 user nova-compute[74534]: DEBUG nova.policy [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6f47ffa03e4eb1a8e70de2b66a47b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892f774d6074fc1b0eb752e802efb5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:49:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Successfully created port: 84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:49:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Successfully updated port: 84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:49:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:49:34 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquired lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:49:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:49:34 user nova-compute[74534]: DEBUG nova.network.neutron [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-changed-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Refreshing instance network info cache due to event network-changed-84dc968b-d340-4f01-a759-00e0ba29dd8c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] Acquiring lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 2dc1f465-2991-4ca1-b155-c83056e7a786 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Updating instance_info_cache with network_info: [{"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Releasing lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Instance network_info: |[{"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] Acquired lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Refreshing network info cache for port 84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Updated VIF entry in instance network info cache for port 84dc968b-d340-4f01-a759-00e0ba29dd8c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Updating instance_info_cache with network_info: [{"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating instance_info_cache with network_info: [{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-10b6fcaf-0507-4a3f-8f4b-a7264fd73cb6 req-3f567a84-6a9a-4218-87ad-8c86228c46b6 service nova] Releasing lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:49:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:49:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:49:38 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:49:38 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.939804077148438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2dc1f465-2991-4ca1-b155-c83056e7a786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 6b9a1921-f7d4-4ff1-9131-fefc45313518 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:49:38 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG os_brick.utils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5118a499-c19c-4b95-92ad-4b74a2ddd9df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b194c431-3cc2-4d52-8387-c03c787d98ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bac0bf8-3b40-491e-8520-462a4ee76f14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff20af4-24da-44c4-a291-ebed01f27e5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:49:39 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:49:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6bb377-e941-4ea4-b809-01693b006008]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG os_brick.utils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:49:39 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Updating existing volume attachment record: c48cc031-ae5e-4929-89b3-fb80b59e9b10 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:49:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:49:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:49:58 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Creating image(s)
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Ensure instance console log exists: /opt/stack/data/nova/instances/6b9a1921-f7d4-4ff1-9131-fefc45313518/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Start _get_guest_xml network_info=[{"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T12:49:21Z,direct_url=<?>,disk_format='qcow2',id=6856730d-1307-49bb-8593-faa59287e1f8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-12546553',owner='a892f774d6074fc1b0eb752e802efb5b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T12:49:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'guest_format': None, 'attachment_id': 'c48cc031-ae5e-4929-89b3-fb80b59e9b10', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxWaFLEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b9a1921-f7d4-4ff1-9131-fefc45313518', 'attached_at': '', 'detached_at': '', 'volume_id': '8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab', 'serial': '8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:49:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:49:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T12:49:21Z,direct_url=<?>,disk_format='qcow2',id=6856730d-1307-49bb-8593-faa59287e1f8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-12546553',owner='a892f774d6074fc1b0eb752e802efb5b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T12:49:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxWaFLEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:49:58 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:49:58 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:49:58 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7eb36-e0c3-4370-b5bd-b858bf9d7973]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:49:58 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b032a92-5872-4454-8953-48ec8a84e6cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab] added
Nov 02 12:49:58 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[038cce5a-e377-4b13-b9d4-bfc5a3356ecd]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[409039b3-3c49-44b3-9328-6bfb177ad143]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxWaFLEV {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxWaFLEV" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00646e-8799-471b-bc99-63de807960d7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zxWaFLEV'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[247f541d-a9c6-4d94-a51d-4c640b3c0c34]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0abff35-cd58-4428-a1fc-fc04ce93bd70]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:49:58 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:49:58 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b59eec-6590-4c34-a072-2ea7b4e5679f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260]
Nov 02 12:49:58 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260] successful.
Nov 02 12:49:58 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d71f9-10d3-498f-98c9-0912d5577164]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e591710b-d18c-44e7-a7d3-fbacd0ce1729]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:49:58 user nova-compute[74534]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab (non-flash)
Nov 02 12:49:58 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:49:58 user nova-compute[74534]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab (non-flash)
Nov 02 12:49:58 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba403c2-ee34-4c9e-8bc0-aa41b21e61d8]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:49:58 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxWaFLEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26231323937363931', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231323937363931', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-920813816',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-920813816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-920813816',id=48,image_ref='6856730d-1307-49bb-8593-faa59287e1f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW4TfhapQ7mIiX0hPmz3nd2IU+JOGGZco5oj9XnjpnIqPPsVKQG072w9PbdUYv1zcrQwc76yVPmesqR54X7oVOs+Y2l3HLpnapgOLHoXpXudnJlcRs/mweySIvY5/A5gg==',key_name='tempest-keypair-1618839826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-ka7h5tsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1985560946',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=6b9a1921-f7d4-4ff1-9131-fefc45313518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=84dc968b-d340-4f01-a759-00e0ba29dd8c,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc968b-d3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.objects.instance [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b9a1921-f7d4-4ff1-9131-fefc45313518 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:49:59 user nova-compute[74534]:   <uuid>6b9a1921-f7d4-4ff1-9131-fefc45313518</uuid>
Nov 02 12:49:59 user nova-compute[74534]:   <name>instance-00000030</name>
Nov 02 12:49:59 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:49:59 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:49:59 user nova-compute[74534]:   <metadata>
Nov 02 12:49:59 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:49:59 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:49:59 user nova-compute[74534]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-920813816</nova:name>
Nov 02 12:49:59 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:49:58</nova:creationTime>
Nov 02 12:49:59 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:49:59 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:49:59 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:49:59 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:49:59 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:49:59 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:49:59 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:49:59 user nova-compute[74534]:       <nova:owner>
Nov 02 12:49:59 user nova-compute[74534]:         <nova:user uuid="0c6f47ffa03e4eb1a8e70de2b66a47b6">tempest-TestVolumeBootPattern-1985560946-project-member</nova:user>
Nov 02 12:49:59 user nova-compute[74534]:         <nova:project uuid="a892f774d6074fc1b0eb752e802efb5b">tempest-TestVolumeBootPattern-1985560946</nova:project>
Nov 02 12:49:59 user nova-compute[74534]:       </nova:owner>
Nov 02 12:49:59 user nova-compute[74534]:       <nova:root type="image" uuid="6856730d-1307-49bb-8593-faa59287e1f8"/>
Nov 02 12:49:59 user nova-compute[74534]:       <nova:ports>
Nov 02 12:49:59 user nova-compute[74534]:         <nova:port uuid="84dc968b-d340-4f01-a759-00e0ba29dd8c">
Nov 02 12:49:59 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 12:49:59 user nova-compute[74534]:         </nova:port>
Nov 02 12:49:59 user nova-compute[74534]:       </nova:ports>
Nov 02 12:49:59 user nova-compute[74534]:     </nova:instance>
Nov 02 12:49:59 user nova-compute[74534]:   </metadata>
Nov 02 12:49:59 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:49:59 user nova-compute[74534]:     <system>
Nov 02 12:49:59 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:49:59 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:49:59 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:49:59 user nova-compute[74534]:       <entry name="serial">6b9a1921-f7d4-4ff1-9131-fefc45313518</entry>
Nov 02 12:49:59 user nova-compute[74534]:       <entry name="uuid">6b9a1921-f7d4-4ff1-9131-fefc45313518</entry>
Nov 02 12:49:59 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:49:59 user nova-compute[74534]:     </system>
Nov 02 12:49:59 user nova-compute[74534]:   </sysinfo>
Nov 02 12:49:59 user nova-compute[74534]:   <os>
Nov 02 12:49:59 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:49:59 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:49:59 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:49:59 user nova-compute[74534]:   </os>
Nov 02 12:49:59 user nova-compute[74534]:   <features>
Nov 02 12:49:59 user nova-compute[74534]:     <acpi/>
Nov 02 12:49:59 user nova-compute[74534]:     <apic/>
Nov 02 12:49:59 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:49:59 user nova-compute[74534]:   </features>
Nov 02 12:49:59 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:49:59 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:49:59 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:49:59 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:49:59 user nova-compute[74534]:   </clock>
Nov 02 12:49:59 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:49:59 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:49:59 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:49:59 user nova-compute[74534]:   </cpu>
Nov 02 12:49:59 user nova-compute[74534]:   <devices>
Nov 02 12:49:59 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:49:59 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:49:59 user nova-compute[74534]:       <source dev="/dev/sdc"/>
Nov 02 12:49:59 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:49:59 user nova-compute[74534]:       <serial>8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab</serial>
Nov 02 12:49:59 user nova-compute[74534]:     </disk>
Nov 02 12:49:59 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:49:59 user nova-compute[74534]:       <mac address="fa:16:3e:1a:6a:95"/>
Nov 02 12:49:59 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:49:59 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:49:59 user nova-compute[74534]:       <target dev="tap84dc968b-d3"/>
Nov 02 12:49:59 user nova-compute[74534]:     </interface>
Nov 02 12:49:59 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:49:59 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/6b9a1921-f7d4-4ff1-9131-fefc45313518/console.log" append="off"/>
Nov 02 12:49:59 user nova-compute[74534]:     </serial>
Nov 02 12:49:59 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:49:59 user nova-compute[74534]:     <video>
Nov 02 12:49:59 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:49:59 user nova-compute[74534]:     </video>
Nov 02 12:49:59 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:49:59 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:49:59 user nova-compute[74534]:     </rng>
Nov 02 12:49:59 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:49:59 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:49:59 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:49:59 user nova-compute[74534]:     </memballoon>
Nov 02 12:49:59 user nova-compute[74534]:   </devices>
Nov 02 12:49:59 user nova-compute[74534]: </domain>
Nov 02 12:49:59 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-920813816',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-920813816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-920813816',id=48,image_ref='6856730d-1307-49bb-8593-faa59287e1f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW4TfhapQ7mIiX0hPmz3nd2IU+JOGGZco5oj9XnjpnIqPPsVKQG072w9PbdUYv1zcrQwc76yVPmesqR54X7oVOs+Y2l3HLpnapgOLHoXpXudnJlcRs/mweySIvY5/A5gg==',key_name='tempest-keypair-1618839826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-ka7h5tsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1985560946',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=6b9a1921-f7d4-4ff1-9131-fefc45313518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=84dc968b-d340-4f01-a759-00e0ba29dd8c,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc968b-d3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG os_vif [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=84dc968b-d340-4f01-a759-00e0ba29dd8c,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc968b-d3') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa72bb24-2b2d-565b-ba56-f23f8f3a4cc5', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84dc968b-d3, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84dc968b-d3, col_values=(('qos', UUID('7fc5ec3f-ae13-4d27-814b-cf0b9f5fa5f1')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84dc968b-d3, col_values=(('external_ids', {'iface-id': '84dc968b-d340-4f01-a759-00e0ba29dd8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:6a:95', 'vm-uuid': '6b9a1921-f7d4-4ff1-9131-fefc45313518'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:49:59 user nova-compute[74534]: INFO os_vif [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=84dc968b-d340-4f01-a759-00e0ba29dd8c,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc968b-d3')
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:49:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No VIF found with MAC fa:16:3e:1a:6a:95, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:50:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-89c5ae73-7e7b-4c97-90bb-0d27d7e9de25 req-aef8ac11-7ee0-48ca-92a5-8209de7c0312 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:50:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-89c5ae73-7e7b-4c97-90bb-0d27d7e9de25 req-aef8ac11-7ee0-48ca-92a5-8209de7c0312 service nova] Acquiring lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:50:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-89c5ae73-7e7b-4c97-90bb-0d27d7e9de25 req-aef8ac11-7ee0-48ca-92a5-8209de7c0312 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:50:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-89c5ae73-7e7b-4c97-90bb-0d27d7e9de25 req-aef8ac11-7ee0-48ca-92a5-8209de7c0312 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:50:01 user nova-compute[74534]: DEBUG nova.compute.manager [req-89c5ae73-7e7b-4c97-90bb-0d27d7e9de25 req-aef8ac11-7ee0-48ca-92a5-8209de7c0312 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] No waiting events found dispatching network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:50:01 user nova-compute[74534]: WARNING nova.compute.manager [req-89c5ae73-7e7b-4c97-90bb-0d27d7e9de25 req-aef8ac11-7ee0-48ca-92a5-8209de7c0312 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received unexpected event network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c for instance with vm_state building and task_state spawning.
Nov 02 12:50:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:02 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:50:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:50:02 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Instance spawned successfully.
Nov 02 12:50:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:50:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:50:02 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:50:03 user nova-compute[74534]: INFO nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 02 12:50:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:50:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-9ab9ba56-63d2-44e6-a4d2-6f54f7e53b42 req-434ec4a3-6947-4109-bd56-75c81aa25496 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:50:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9ab9ba56-63d2-44e6-a4d2-6f54f7e53b42 req-434ec4a3-6947-4109-bd56-75c81aa25496 service nova] Acquiring lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:50:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9ab9ba56-63d2-44e6-a4d2-6f54f7e53b42 req-434ec4a3-6947-4109-bd56-75c81aa25496 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:50:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9ab9ba56-63d2-44e6-a4d2-6f54f7e53b42 req-434ec4a3-6947-4109-bd56-75c81aa25496 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:50:03 user nova-compute[74534]: DEBUG nova.compute.manager [req-9ab9ba56-63d2-44e6-a4d2-6f54f7e53b42 req-434ec4a3-6947-4109-bd56-75c81aa25496 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] No waiting events found dispatching network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:50:03 user nova-compute[74534]: WARNING nova.compute.manager [req-9ab9ba56-63d2-44e6-a4d2-6f54f7e53b42 req-434ec4a3-6947-4109-bd56-75c81aa25496 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received unexpected event network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c for instance with vm_state building and task_state spawning.
Nov 02 12:50:03 user nova-compute[74534]: INFO nova.compute.manager [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Took 29.97 seconds to build instance.
Nov 02 12:50:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-399e1b23-9560-41fe-9987-48c2b647202a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.073s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:50:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:50:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 2dc1f465-2991-4ca1-b155-c83056e7a786 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating instance_info_cache with network_info: [{"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-2dc1f465-2991-4ca1-b155-c83056e7a786" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:50:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:50:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:50:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:50:40 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:50:40 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8883MB free_disk=24.938369750976562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2dc1f465-2991-4ca1-b155-c83056e7a786 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 6b9a1921-f7d4-4ff1-9131-fefc45313518 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:50:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:50:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:50:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:50:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:50:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:50:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:50:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:50:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:50:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:51:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:51:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:51:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:51:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:51:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:51:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-changed-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:51:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Refreshing instance network info cache due to event network-changed-84dc968b-d340-4f01-a759-00e0ba29dd8c. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:51:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] Acquiring lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:51:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] Acquired lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:51:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Refreshing network info cache for port 84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "6b9a1921-f7d4-4ff1-9131-fefc45313518" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:51:24 user nova-compute[74534]: INFO nova.compute.manager [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Terminating instance
Nov 02 12:51:24 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e35d42c-ceec-482f-ad9e-a5431f2a9427 req-95932e79-554d-49b8-8e94-1b11aae14b66 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-vif-unplugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e35d42c-ceec-482f-ad9e-a5431f2a9427 req-95932e79-554d-49b8-8e94-1b11aae14b66 service nova] Acquiring lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e35d42c-ceec-482f-ad9e-a5431f2a9427 req-95932e79-554d-49b8-8e94-1b11aae14b66 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5e35d42c-ceec-482f-ad9e-a5431f2a9427 req-95932e79-554d-49b8-8e94-1b11aae14b66 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e35d42c-ceec-482f-ad9e-a5431f2a9427 req-95932e79-554d-49b8-8e94-1b11aae14b66 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] No waiting events found dispatching network-vif-unplugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-5e35d42c-ceec-482f-ad9e-a5431f2a9427 req-95932e79-554d-49b8-8e94-1b11aae14b66 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-vif-unplugged-84dc968b-d340-4f01-a759-00e0ba29dd8c for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:51:25 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Instance destroyed successfully.
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.objects.instance [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'resources' on Instance uuid 6b9a1921-f7d4-4ff1-9131-fefc45313518 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-920813816',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-920813816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-920813816',id=48,image_ref='6856730d-1307-49bb-8593-faa59287e1f8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW4TfhapQ7mIiX0hPmz3nd2IU+JOGGZco5oj9XnjpnIqPPsVKQG072w9PbdUYv1zcrQwc76yVPmesqR54X7oVOs+Y2l3HLpnapgOLHoXpXudnJlcRs/mweySIvY5/A5gg==',key_name='tempest-keypair-1618839826',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-ka7h5tsb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1985560946',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=6b9a1921-f7d4-4ff1-9131-fefc45313518,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=84dc968b-d340-4f01-a759-00e0ba29dd8c,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc968b-d3') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_vif [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=84dc968b-d340-4f01-a759-00e0ba29dd8c,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc968b-d3') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84dc968b-d3, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fc5ec3f-ae13-4d27-814b-cf0b9f5fa5f1) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:25 user nova-compute[74534]: INFO os_vif [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:6a:95,bridge_name='br-int',has_traffic_filtering=True,id=84dc968b-d340-4f01-a759-00e0ba29dd8c,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84dc968b-d3')
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxWaFLEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:51:25 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.network.neutron [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Updated VIF entry in instance network info cache for port 84dc968b-d340-4f01-a759-00e0ba29dd8c. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.network.neutron [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Updating instance_info_cache with network_info: [{"id": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "address": "fa:16:3e:1a:6a:95", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84dc968b-d3", "ovs_interfaceid": "84dc968b-d340-4f01-a759-00e0ba29dd8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-4a859e06-7377-43cb-8a88-fcefd81f2437 req-27ef11f5-492f-4766-a3b5-1c79245e38cb service nova] Releasing lock "refresh_cache-6b9a1921-f7d4-4ff1-9131-fefc45313518" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d586db6-5456-4289-9115-643f884a14ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:51:25 user nova-compute[74534]: No targets found.
Nov 02 12:51:25 user nova-compute[74534]: iSNS:
Nov 02 12:51:25 user nova-compute[74534]: No targets found.
Nov 02 12:51:25 user nova-compute[74534]: STATIC:
Nov 02 12:51:25 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab
Nov 02 12:51:25 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:51:25 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:51:25 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579
Nov 02 12:51:25 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:51:25 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:51:25 user nova-compute[74534]: FIRMWARE:
Nov 02 12:51:25 user nova-compute[74534]: No targets found.
Nov 02 12:51:25 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:51:25 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:51:25 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9492576e-0d5d-4b12-9351-ef5872e8cacb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d80c6-6a5e-47bd-8aaf-98456ade5484]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:51:25 user nova-compute[74534]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab (non-flash)
Nov 02 12:51:25 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:51:25 user nova-compute[74534]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab (non-flash)
Nov 02 12:51:25 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c4e3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2282a8d8-e645-4c44-a3ab-23057aa2cdbb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[34500a64-4d50-4897-8310-1a52513cd82a]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[012aca82-cab2-4d2a-8217-4671dcae4e14]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee02ba3a-e712-4055-b5eb-110c57b98f14]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6da9033d', '/dev/disk/by-id/scsi-26231323937363931', '/dev/disk/by-id/scsi-1SCST_BIO6da9033d-b129769177166d37') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ce0b9-bcc4-4e91-b535-ad9f68eb9464]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8376ec9f-85ac-4032-b0ee-adc401893e47]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e86a57-eebc-4425-ab75-633bee16dbf2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260]
Nov 02 12:51:25 user nova-compute[74534]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab, portal: 172.16.0.220,3260] successful.
Nov 02 12:51:25 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[143663be-aa21-46f4-9727-2ca23f56fed0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== disconnect_volume: return (343ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:51:25 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Deleting instance files /opt/stack/data/nova/instances/6b9a1921-f7d4-4ff1-9131-fefc45313518_del
Nov 02 12:51:25 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Deletion of /opt/stack/data/nova/instances/6b9a1921-f7d4-4ff1-9131-fefc45313518_del complete
Nov 02 12:51:25 user nova-compute[74534]: INFO nova.compute.manager [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 02 12:51:25 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:51:25 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:51:26 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:51:26 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Took 0.71 seconds to deallocate network for instance.
Nov 02 12:51:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-d422ce56-2137-41c6-921e-69322f1dc104 req-5dd86ad8-88f9-4518-a71f-564401ddd134 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d422ce56-2137-41c6-921e-69322f1dc104 req-5dd86ad8-88f9-4518-a71f-564401ddd134 service nova] Acquiring lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d422ce56-2137-41c6-921e-69322f1dc104 req-5dd86ad8-88f9-4518-a71f-564401ddd134 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d422ce56-2137-41c6-921e-69322f1dc104 req-5dd86ad8-88f9-4518-a71f-564401ddd134 service nova] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-d422ce56-2137-41c6-921e-69322f1dc104 req-5dd86ad8-88f9-4518-a71f-564401ddd134 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] No waiting events found dispatching network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:51:27 user nova-compute[74534]: WARNING nova.compute.manager [req-d422ce56-2137-41c6-921e-69322f1dc104 req-5dd86ad8-88f9-4518-a71f-564401ddd134 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received unexpected event network-vif-plugged-84dc968b-d340-4f01-a759-00e0ba29dd8c for instance with vm_state active and task_state deleting.
Nov 02 12:51:27 user nova-compute[74534]: DEBUG nova.compute.manager [req-d422ce56-2137-41c6-921e-69322f1dc104 req-5dd86ad8-88f9-4518-a71f-564401ddd134 service nova] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Received event network-vif-deleted-84dc968b-d340-4f01-a759-00e0ba29dd8c {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:51:27 user nova-compute[74534]: INFO nova.compute.manager [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Took 1.05 seconds to detach 1 volumes for instance.
Nov 02 12:51:27 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 6b9a1921-f7d4-4ff1-9131-fefc45313518] Deleting volume: 8b84f23d-cd3c-4b5e-9917-0bb2d1e401ab {{(pid=74534) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:51:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:51:27 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Deleted allocations for instance 6b9a1921-f7d4-4ff1-9131-fefc45313518
Nov 02 12:51:27 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b832de25-bb23-4994-b3da-afe72a95c74e tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "6b9a1921-f7d4-4ff1-9131-fefc45313518" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.413s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:51:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:51:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:34 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:51:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:51:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:51:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:51:42 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:51:42 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.937484741210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 2dc1f465-2991-4ca1-b155-c83056e7a786 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:51:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:51:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:51:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:51:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:51:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:51:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:51:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:51:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:52:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "2dc1f465-2991-4ca1-b155-c83056e7a786" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:52:25 user nova-compute[74534]: INFO nova.compute.manager [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Terminating instance
Nov 02 12:52:25 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-7f81aea6-21d1-4950-83a6-3b567bfe864a req-2d035bb0-b1fd-4ac8-a5c8-64b26862e29b service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-vif-unplugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7f81aea6-21d1-4950-83a6-3b567bfe864a req-2d035bb0-b1fd-4ac8-a5c8-64b26862e29b service nova] Acquiring lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7f81aea6-21d1-4950-83a6-3b567bfe864a req-2d035bb0-b1fd-4ac8-a5c8-64b26862e29b service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-7f81aea6-21d1-4950-83a6-3b567bfe864a req-2d035bb0-b1fd-4ac8-a5c8-64b26862e29b service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-7f81aea6-21d1-4950-83a6-3b567bfe864a req-2d035bb0-b1fd-4ac8-a5c8-64b26862e29b service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] No waiting events found dispatching network-vif-unplugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:52:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-7f81aea6-21d1-4950-83a6-3b567bfe864a req-2d035bb0-b1fd-4ac8-a5c8-64b26862e29b service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-vif-unplugged-0972289d-b5b6-49c5-bb79-57064440ca15 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Instance destroyed successfully.
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.objects.instance [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'resources' on Instance uuid 2dc1f465-2991-4ca1-b155-c83056e7a786 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:47:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-916313530',display_name='tempest-TestVolumeBootPattern-volume-backed-server-916313530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-916313530',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwAKIJVJ2yQdwVMwQpvM9IvMHdh+sOXCggGua7Kl9/KcooWp4tOyHN1aVrMvM2fWs4dIuPHYrqhx89rvkXakDXG2JX08Arzg3DKHEBLHoS8o53LDeFV8sCr+Z6Rjh8s3w==',key_name='tempest-keypair-1741581975',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:47:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-7ea0rgm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:48:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=2dc1f465-2991-4ca1-b155-c83056e7a786,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "0972289d-b5b6-49c5-bb79-57064440ca15", "address": "fa:16:3e:40:a0:e7", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0972289d-b5", "ovs_interfaceid": "0972289d-b5b6-49c5-bb79-57064440ca15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0972289d-b5b6-49c5-bb79-57064440ca15,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0972289d-b5') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_vif [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0972289d-b5b6-49c5-bb79-57064440ca15,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0972289d-b5') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0972289d-b5, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b06b95b9-3f64-46c1-8dc5-1f404a486bdf) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:26 user nova-compute[74534]: INFO os_vif [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:a0:e7,bridge_name='br-int',has_traffic_filtering=True,id=0972289d-b5b6-49c5-bb79-57064440ca15,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0972289d-b5')
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIzvsWwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:52:26 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8cd373-aa6a-45e0-8c61-3f2570bc6483]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:52:26 user nova-compute[74534]: No targets found.
Nov 02 12:52:26 user nova-compute[74534]: iSNS:
Nov 02 12:52:26 user nova-compute[74534]: No targets found.
Nov 02 12:52:26 user nova-compute[74534]: STATIC:
Nov 02 12:52:26 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579
Nov 02 12:52:26 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:52:26 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:52:26 user nova-compute[74534]: FIRMWARE:
Nov 02 12:52:26 user nova-compute[74534]: No targets found.
Nov 02 12:52:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:52:26 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:52:26 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cd01de-cb4a-456c-bb57-2b2d5f368718]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cdc47c-93e5-4018-8547-3fab57a41ddf]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:52:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 (non-flash)
Nov 02 12:52:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c41d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70e40c6-29b8-4b64-9669-0786e30bdd0c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c53969-ae0a-41bb-8bf1-1faa52377d16]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08069ffd-e6bf-40a4-955b-6aa7176069ac]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abcb1b5-11c1-4120-a2da-1e00be773028]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf15b8c09-1af896ad40e67396', '/dev/disk/by-id/scsi-23161663839366164', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f15b8c09') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4660f020-c3cb-4a71-bc9f-56ebd72d6c83]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323b3eb-f9c0-48bf-a5d5-0d4d11046d70]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69ffb4-45c2-453c-b1c5-326b4dcfc6fd]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260]
Nov 02 12:52:26 user nova-compute[74534]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579, portal: 172.16.0.220,3260] successful.
Nov 02 12:52:26 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beee5c8f-dbaf-4a74-bc56-6931274a8579 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[860cab7d-6be7-46ea-8beb-ffeb35c227b6]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== disconnect_volume: return (282ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:52:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Deleting instance files /opt/stack/data/nova/instances/2dc1f465-2991-4ca1-b155-c83056e7a786_del
Nov 02 12:52:26 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Deletion of /opt/stack/data/nova/instances/2dc1f465-2991-4ca1-b155-c83056e7a786_del complete
Nov 02 12:52:26 user nova-compute[74534]: INFO nova.compute.manager [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 02 12:52:26 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:52:26 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:52:27 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:52:27 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Took 0.72 seconds to deallocate network for instance.
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-d54d9452-f94a-49e0-b202-cc577317bd9c req-aac414d0-528e-44bb-aedc-7b88cdeee159 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d54d9452-f94a-49e0-b202-cc577317bd9c req-aac414d0-528e-44bb-aedc-7b88cdeee159 service nova] Acquiring lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d54d9452-f94a-49e0-b202-cc577317bd9c req-aac414d0-528e-44bb-aedc-7b88cdeee159 service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d54d9452-f94a-49e0-b202-cc577317bd9c req-aac414d0-528e-44bb-aedc-7b88cdeee159 service nova] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-d54d9452-f94a-49e0-b202-cc577317bd9c req-aac414d0-528e-44bb-aedc-7b88cdeee159 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] No waiting events found dispatching network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:52:28 user nova-compute[74534]: WARNING nova.compute.manager [req-d54d9452-f94a-49e0-b202-cc577317bd9c req-aac414d0-528e-44bb-aedc-7b88cdeee159 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received unexpected event network-vif-plugged-0972289d-b5b6-49c5-bb79-57064440ca15 for instance with vm_state active and task_state deleting.
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-d54d9452-f94a-49e0-b202-cc577317bd9c req-aac414d0-528e-44bb-aedc-7b88cdeee159 service nova] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Received event network-vif-deleted-0972289d-b5b6-49c5-bb79-57064440ca15 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:52:28 user nova-compute[74534]: INFO nova.compute.manager [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Took 0.96 seconds to detach 1 volumes for instance.
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 2dc1f465-2991-4ca1-b155-c83056e7a786] Deleting volume: beee5c8f-dbaf-4a74-bc56-6931274a8579 {{(pid=74534) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:52:28 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:52:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:52:29 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Deleted allocations for instance 2dc1f465-2991-4ca1-b155-c83056e7a786
Nov 02 12:52:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-cbccd4cf-707a-4c9e-9bb4-32849b81bc53 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "2dc1f465-2991-4ca1-b155-c83056e7a786" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.442s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:52:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:29 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:52:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:33 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:52:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:52:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:52:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:52:44 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:52:44 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:52:44 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=24.93661880493164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:52:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:52:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:52:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:52:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:17 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:30 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:53:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:53:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:53:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:53:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:53:36 user nova-compute[74534]: INFO nova.compute.claims [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Claim successful on node user
Nov 02 12:53:36 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:53:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:53:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:53:37 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG nova.policy [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6f47ffa03e4eb1a8e70de2b66a47b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892f774d6074fc1b0eb752e802efb5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:53:37 user nova-compute[74534]: INFO nova.virt.block_device [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Booting with volume 0f3b009e-d56e-49f5-859b-df3b31ad6ae8 at /dev/vda
Nov 02 12:53:37 user nova-compute[74534]: DEBUG os_brick.utils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[99435597-19dc-4af2-9d5c-da6d5af66ac9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6627e5e-7394-4d78-a52b-a50f55ae389f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc6363-f58e-4fd4-b8ac-78a552e203f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc80dca-ac67-4f19-933b-68449a1646f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:53:37 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:53:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75ab2fc-74a9-4ec5-b486-f13bab91ddcb]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG os_brick.utils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updating existing volume attachment record: 028eb415-5028-4ad9-9f17-f67089312bc0 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:53:37 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Successfully created port: 8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Successfully updated port: 8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquired lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-changed-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.compute.manager [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Refreshing instance network info cache due to event network-changed-8fab3f21-6565-4642-aa47-9521c5315917. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] Acquiring lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.network.neutron [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updating instance_info_cache with network_info: [{"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Releasing lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Instance network_info: |[{"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] Acquired lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:53:38 user nova-compute[74534]: DEBUG nova.network.neutron [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Refreshing network info cache for port 8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:53:39 user nova-compute[74534]: DEBUG nova.network.neutron [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updated VIF entry in instance network info cache for port 8fab3f21-6565-4642-aa47-9521c5315917. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:53:39 user nova-compute[74534]: DEBUG nova.network.neutron [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updating instance_info_cache with network_info: [{"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:53:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-086a707e-17a6-44ee-94e7-ec7ff3bdc486 req-fdfc9178-c3e2-42a7-b215-9bd21ee40d29 service nova] Releasing lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:53:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:46 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:53:46 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9136MB free_disk=24.9351806640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 0274f3ec-0bbb-475d-a546-a1381dc7dbcb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:53:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:53:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:53:55 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Creating image(s)
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Ensure instance console log exists: /opt/stack/data/nova/instances/0274f3ec-0bbb-475d-a546-a1381dc7dbcb/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Start _get_guest_xml network_info=[{"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': '028eb415-5028-4ad9-9f17-f67089312bc0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0274f3ec-0bbb-475d-a546-a1381dc7dbcb', 'attached_at': '', 'detached_at': '', 'volume_id': '0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'serial': '0f3b009e-d56e-49f5-859b-df3b31ad6ae8'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:53:55 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:53:55 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:53:55 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:53:55 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:53:55 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9968130-3bb8-467d-afa8-9e22941fc957]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:53:55 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf9755f-da75-4b9f-907c-436329bb5fce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8] added
Nov 02 12:53:55 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20d2e9-5d7c-4bfd-b4b6-c662d06b419a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa74184f-0ef6-45cf-b18e-359ba287d18f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjRVaWOk {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjRVaWOk" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19fcdad-0cbe-423f-ac51-49a0da76bfb5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjRVaWOk'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b9aebb-e74a-4c39-988d-9a587a74b9a8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b158d73-cfb3-4b26-97b0-759a6437dfd2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:53:55 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:53:55 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:53:55 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:53:55 user nova-compute[74534]: 
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c195c0-6ae4-4ea4-924b-49fd56687c4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]
Nov 02 12:53:55 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.
Nov 02 12:53:55 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33066ec-6929-45bc-ab1f-643ede4ee1f4]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a501d409-f28d-4240-b308-5d5801190718]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:53:55 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:53:55 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e29cd27-5ede-4d4b-bbc3-a65b68bb72d9]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:53:55 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23232633861623736', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232633861623736', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1480109467',display_name='tempest-TestVolumeBootPattern-server-1480109467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1480109467',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-5hy9bhn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:53:37Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=0274f3ec-0bbb-475d-a546-a1381dc7dbcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=8fab3f21-6565-4642-aa47-9521c5315917,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fab3f21-65') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.objects.instance [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'pci_devices' on Instance uuid 0274f3ec-0bbb-475d-a546-a1381dc7dbcb {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:53:56 user nova-compute[74534]:   <uuid>0274f3ec-0bbb-475d-a546-a1381dc7dbcb</uuid>
Nov 02 12:53:56 user nova-compute[74534]:   <name>instance-00000031</name>
Nov 02 12:53:56 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:53:56 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:53:56 user nova-compute[74534]:   <metadata>
Nov 02 12:53:56 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:53:56 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:53:56 user nova-compute[74534]:       <nova:name>tempest-TestVolumeBootPattern-server-1480109467</nova:name>
Nov 02 12:53:56 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:53:55</nova:creationTime>
Nov 02 12:53:56 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:53:56 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:53:56 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:53:56 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:53:56 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:53:56 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:53:56 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:53:56 user nova-compute[74534]:       <nova:owner>
Nov 02 12:53:56 user nova-compute[74534]:         <nova:user uuid="0c6f47ffa03e4eb1a8e70de2b66a47b6">tempest-TestVolumeBootPattern-1985560946-project-member</nova:user>
Nov 02 12:53:56 user nova-compute[74534]:         <nova:project uuid="a892f774d6074fc1b0eb752e802efb5b">tempest-TestVolumeBootPattern-1985560946</nova:project>
Nov 02 12:53:56 user nova-compute[74534]:       </nova:owner>
Nov 02 12:53:56 user nova-compute[74534]:       <nova:ports>
Nov 02 12:53:56 user nova-compute[74534]:         <nova:port uuid="8fab3f21-6565-4642-aa47-9521c5315917">
Nov 02 12:53:56 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:53:56 user nova-compute[74534]:         </nova:port>
Nov 02 12:53:56 user nova-compute[74534]:       </nova:ports>
Nov 02 12:53:56 user nova-compute[74534]:     </nova:instance>
Nov 02 12:53:56 user nova-compute[74534]:   </metadata>
Nov 02 12:53:56 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:53:56 user nova-compute[74534]:     <system>
Nov 02 12:53:56 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:53:56 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:53:56 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:53:56 user nova-compute[74534]:       <entry name="serial">0274f3ec-0bbb-475d-a546-a1381dc7dbcb</entry>
Nov 02 12:53:56 user nova-compute[74534]:       <entry name="uuid">0274f3ec-0bbb-475d-a546-a1381dc7dbcb</entry>
Nov 02 12:53:56 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:53:56 user nova-compute[74534]:     </system>
Nov 02 12:53:56 user nova-compute[74534]:   </sysinfo>
Nov 02 12:53:56 user nova-compute[74534]:   <os>
Nov 02 12:53:56 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:53:56 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:53:56 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:53:56 user nova-compute[74534]:   </os>
Nov 02 12:53:56 user nova-compute[74534]:   <features>
Nov 02 12:53:56 user nova-compute[74534]:     <acpi/>
Nov 02 12:53:56 user nova-compute[74534]:     <apic/>
Nov 02 12:53:56 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:53:56 user nova-compute[74534]:   </features>
Nov 02 12:53:56 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:53:56 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:53:56 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:53:56 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:53:56 user nova-compute[74534]:   </clock>
Nov 02 12:53:56 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:53:56 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:53:56 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:53:56 user nova-compute[74534]:   </cpu>
Nov 02 12:53:56 user nova-compute[74534]:   <devices>
Nov 02 12:53:56 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:53:56 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:53:56 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:53:56 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:53:56 user nova-compute[74534]:       <serial>0f3b009e-d56e-49f5-859b-df3b31ad6ae8</serial>
Nov 02 12:53:56 user nova-compute[74534]:     </disk>
Nov 02 12:53:56 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:53:56 user nova-compute[74534]:       <mac address="fa:16:3e:42:1e:ef"/>
Nov 02 12:53:56 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:53:56 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:53:56 user nova-compute[74534]:       <target dev="tap8fab3f21-65"/>
Nov 02 12:53:56 user nova-compute[74534]:     </interface>
Nov 02 12:53:56 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:53:56 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/0274f3ec-0bbb-475d-a546-a1381dc7dbcb/console.log" append="off"/>
Nov 02 12:53:56 user nova-compute[74534]:     </serial>
Nov 02 12:53:56 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:53:56 user nova-compute[74534]:     <video>
Nov 02 12:53:56 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:53:56 user nova-compute[74534]:     </video>
Nov 02 12:53:56 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:53:56 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:53:56 user nova-compute[74534]:     </rng>
Nov 02 12:53:56 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:53:56 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:53:56 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:53:56 user nova-compute[74534]:     </memballoon>
Nov 02 12:53:56 user nova-compute[74534]:   </devices>
Nov 02 12:53:56 user nova-compute[74534]: </domain>
Nov 02 12:53:56 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1480109467',display_name='tempest-TestVolumeBootPattern-server-1480109467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1480109467',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-5hy9bhn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:53:37Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=0274f3ec-0bbb-475d-a546-a1381dc7dbcb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=8fab3f21-6565-4642-aa47-9521c5315917,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fab3f21-65') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG os_vif [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=8fab3f21-6565-4642-aa47-9521c5315917,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fab3f21-65') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7346261a-1d04-58b1-b206-ae05334d1bec', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fab3f21-65, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fab3f21-65, col_values=(('qos', UUID('46b630de-f2ac-4dfd-9cf3-a7153202ab55')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fab3f21-65, col_values=(('external_ids', {'iface-id': '8fab3f21-6565-4642-aa47-9521c5315917', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:1e:ef', 'vm-uuid': '0274f3ec-0bbb-475d-a546-a1381dc7dbcb'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:56 user nova-compute[74534]: INFO os_vif [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=8fab3f21-6565-4642-aa47-9521c5315917,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fab3f21-65')
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:53:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No VIF found with MAC fa:16:3e:42:1e:ef, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-f36fd56d-128a-4081-8347-7700ec311199 req-b88d2e7d-022d-41b1-b36a-aa41b0eef33f service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f36fd56d-128a-4081-8347-7700ec311199 req-b88d2e7d-022d-41b1-b36a-aa41b0eef33f service nova] Acquiring lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f36fd56d-128a-4081-8347-7700ec311199 req-b88d2e7d-022d-41b1-b36a-aa41b0eef33f service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-f36fd56d-128a-4081-8347-7700ec311199 req-b88d2e7d-022d-41b1-b36a-aa41b0eef33f service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG nova.compute.manager [req-f36fd56d-128a-4081-8347-7700ec311199 req-b88d2e7d-022d-41b1-b36a-aa41b0eef33f service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] No waiting events found dispatching network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:53:58 user nova-compute[74534]: WARNING nova.compute.manager [req-f36fd56d-128a-4081-8347-7700ec311199 req-b88d2e7d-022d-41b1-b36a-aa41b0eef33f service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received unexpected event network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 for instance with vm_state building and task_state spawning.
Nov 02 12:53:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:53:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:54:00 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Instance spawned successfully.
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:54:00 user nova-compute[74534]: INFO nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-0ae3825c-e15d-4b19-bd69-f61cfaf01e4b req-77da7b14-d196-4045-94a5-16b1323a33b3 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0ae3825c-e15d-4b19-bd69-f61cfaf01e4b req-77da7b14-d196-4045-94a5-16b1323a33b3 service nova] Acquiring lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0ae3825c-e15d-4b19-bd69-f61cfaf01e4b req-77da7b14-d196-4045-94a5-16b1323a33b3 service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-0ae3825c-e15d-4b19-bd69-f61cfaf01e4b req-77da7b14-d196-4045-94a5-16b1323a33b3 service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG nova.compute.manager [req-0ae3825c-e15d-4b19-bd69-f61cfaf01e4b req-77da7b14-d196-4045-94a5-16b1323a33b3 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] No waiting events found dispatching network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:54:00 user nova-compute[74534]: WARNING nova.compute.manager [req-0ae3825c-e15d-4b19-bd69-f61cfaf01e4b req-77da7b14-d196-4045-94a5-16b1323a33b3 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received unexpected event network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 for instance with vm_state building and task_state spawning.
Nov 02 12:54:00 user nova-compute[74534]: INFO nova.compute.manager [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Took 23.71 seconds to build instance.
Nov 02 12:54:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-5e1e0022-f55b-44b6-89c9-86801aab0566 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.799s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:54:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:54:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:54:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:31 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:31 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:54:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:54:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:54:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 0274f3ec-0bbb-475d-a546-a1381dc7dbcb {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updating instance_info_cache with network_info: [{"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:54:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:54:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:54:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:54:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:54:46 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:54:46 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=24.933773040771484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 0274f3ec-0bbb-475d-a546-a1381dc7dbcb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:54:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:54:47 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:54:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:54:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:54:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:54:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:54:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:54:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:54:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:55:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:55:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:55:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-changed-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG nova.compute.manager [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Refreshing instance network info cache due to event network-changed-8fab3f21-6565-4642-aa47-9521c5315917. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] Acquiring lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] Acquired lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG nova.network.neutron [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Refreshing network info cache for port 8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG nova.network.neutron [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updated VIF entry in instance network info cache for port 8fab3f21-6565-4642-aa47-9521c5315917. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG nova.network.neutron [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updating instance_info_cache with network_info: [{"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:55:28 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-94818e82-1f4b-4302-ab65-f8e4785a2ddb req-90954620-3504-4d3f-aab4-86e465363331 service nova] Releasing lock "refresh_cache-0274f3ec-0bbb-475d-a546-a1381dc7dbcb" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:55:28 user nova-compute[74534]: INFO nova.compute.manager [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Terminating instance
Nov 02 12:55:28 user nova-compute[74534]: DEBUG nova.compute.manager [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:29 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Instance destroyed successfully.
Nov 02 12:55:29 user nova-compute[74534]: DEBUG nova.objects.instance [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'resources' on Instance uuid 0274f3ec-0bbb-475d-a546-a1381dc7dbcb {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1480109467',display_name='tempest-TestVolumeBootPattern-server-1480109467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1480109467',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-5hy9bhn2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:54:00Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=0274f3ec-0bbb-475d-a546-a1381dc7dbcb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "8fab3f21-6565-4642-aa47-9521c5315917", "address": "fa:16:3e:42:1e:ef", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fab3f21-65", "ovs_interfaceid": "8fab3f21-6565-4642-aa47-9521c5315917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=8fab3f21-6565-4642-aa47-9521c5315917,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fab3f21-65') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:55:29 user nova-compute[74534]: DEBUG os_vif [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=8fab3f21-6565-4642-aa47-9521c5315917,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fab3f21-65') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fab3f21-65, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46b630de-f2ac-4dfd-9cf3-a7153202ab55) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:30 user nova-compute[74534]: INFO os_vif [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1e:ef,bridge_name='br-int',has_traffic_filtering=True,id=8fab3f21-6565-4642-aa47-9521c5315917,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fab3f21-65')
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:55:30 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ad6517-2a44-465f-ac12-e1f631d366c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 12:55:30 user nova-compute[74534]: No targets found.
Nov 02 12:55:30 user nova-compute[74534]: iSNS:
Nov 02 12:55:30 user nova-compute[74534]: No targets found.
Nov 02 12:55:30 user nova-compute[74534]: STATIC:
Nov 02 12:55:30 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8
Nov 02 12:55:30 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 12:55:30 user nova-compute[74534]:                 Iface Name: default
Nov 02 12:55:30 user nova-compute[74534]: FIRMWARE:
Nov 02 12:55:30 user nova-compute[74534]: No targets found.
Nov 02 12:55:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 12:55:30 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 12:55:30 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa1f17c-77a6-4292-a55c-b7d21ad0aba0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93fceb-61c5-4634-825c-bcb8ac8df59a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:55:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:55:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c43b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[73321874-1171-40af-9ae9-9982ede879cb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ea3ab-a3eb-4d22-9327-491a717f24ee]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bd3c45-ac27-4825-9e55-f2c74c5bf21b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2377e3f6-b693-4afc-8dc5-b6f0c373377c]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c73de5-8a23-48e9-890e-b027ceead4e8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb374ae-8fcb-49ea-b488-5a6deff5b0b0]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]
Nov 02 12:55:30 user nova-compute[74534]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.
Nov 02 12:55:30 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[936dd72a-0ff7-4252-992a-5a71e4a65515]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== disconnect_volume: return (290ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 12:55:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Deleting instance files /opt/stack/data/nova/instances/0274f3ec-0bbb-475d-a546-a1381dc7dbcb_del
Nov 02 12:55:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Deletion of /opt/stack/data/nova/instances/0274f3ec-0bbb-475d-a546-a1381dc7dbcb_del complete
Nov 02 12:55:30 user nova-compute[74534]: INFO nova.compute.manager [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-vif-unplugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] Acquiring lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] No waiting events found dispatching network-vif-unplugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-vif-unplugged-8fab3f21-6565-4642-aa47-9521c5315917 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] Acquiring lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:55:30 user nova-compute[74534]: DEBUG nova.compute.manager [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] No waiting events found dispatching network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:55:30 user nova-compute[74534]: WARNING nova.compute.manager [req-e41619b4-ca16-4915-9ae2-e2959576fd65 req-76830374-4994-49dc-9530-3950df4229c1 service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received unexpected event network-vif-plugged-8fab3f21-6565-4642-aa47-9521c5315917 for instance with vm_state active and task_state deleting.
Nov 02 12:55:31 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:55:31 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Took 1.06 seconds to deallocate network for instance.
Nov 02 12:55:31 user nova-compute[74534]: DEBUG nova.compute.manager [req-34f9c6ed-6698-43c0-b245-4d6aa0529518 req-0e3f8cac-33a9-46ea-b0dd-02732042cd7a service nova] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Received event network-vif-deleted-8fab3f21-6565-4642-aa47-9521c5315917 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:55:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:55:32 user nova-compute[74534]: INFO nova.compute.manager [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 0274f3ec-0bbb-475d-a546-a1381dc7dbcb] Took 0.92 seconds to detach 1 volumes for instance.
Nov 02 12:55:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:55:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:55:32 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:55:32 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:55:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:55:32 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Deleted allocations for instance 0274f3ec-0bbb-475d-a546-a1381dc7dbcb
Nov 02 12:55:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-7033dcc9-58a8-4c42-8a11-4e50f9bbf858 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "0274f3ec-0bbb-475d-a546-a1381dc7dbcb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.767s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:55:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:55:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:55:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:55:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:55:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:55:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:55:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:55:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:47 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:55:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:55:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:55:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9111MB free_disk=24.93294906616211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:55:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:55:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:55:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:56:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:56:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:56:20 user nova-compute[74534]: INFO nova.compute.claims [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Claim successful on node user
Nov 02 12:56:20 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:56:20 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:56:21 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:56:21 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG nova.policy [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6f47ffa03e4eb1a8e70de2b66a47b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892f774d6074fc1b0eb752e802efb5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:56:21 user nova-compute[74534]: INFO nova.virt.block_device [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Booting with volume 0f3b009e-d56e-49f5-859b-df3b31ad6ae8 at /dev/vda
Nov 02 12:56:21 user nova-compute[74534]: DEBUG os_brick.utils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9287df2c-0714-4b2a-9e0a-36a62328968f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f84bb3-4c61-4cf8-8c8c-b9bf57f86681]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c6bc6-b256-40e3-be9b-aecee84dc8da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1078bbed-40f5-4c9e-a631-374f65661efa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:56:21 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:56:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[85145135-1789-4af8-aa4f-032fa37d9908]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG os_brick.utils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating existing volume attachment record: 34f13f91-435b-44aa-8847-72e3661cd6aa {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:56:21 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Successfully created port: f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Successfully updated port: f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquired lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-changed-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.compute.manager [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Refreshing instance network info cache due to event network-changed-f6bc3818-0588-40a6-a855-f642ec909ee7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] Acquiring lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.network.neutron [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Releasing lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Instance network_info: |[{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] Acquired lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:56:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Refreshing network info cache for port f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:56:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updated VIF entry in instance network info cache for port f6bc3818-0588-40a6-a855-f642ec909ee7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:56:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:56:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a30b5f03-1170-4d0b-8c86-9991bf0033b7 req-d905aaca-9c67-4018-8888-c32a18a939c6 service nova] Releasing lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:56:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:56:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:33 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:33 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:56:39 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Creating image(s)
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Ensure instance console log exists: /opt/stack/data/nova/instances/43593bfe-6a5f-434a-903b-4a2d44bcda0c/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Start _get_guest_xml network_info=[{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': '34f13f91-435b-44aa-8847-72e3661cd6aa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43593bfe-6a5f-434a-903b-4a2d44bcda0c', 'attached_at': '', 'detached_at': '', 'volume_id': '0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'serial': '0f3b009e-d56e-49f5-859b-df3b31ad6ae8'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:56:39 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:56:39 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:56:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:56:39 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:56:39 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9cfca-6804-4dee-b79c-99dec8fe8733]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:56:39 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[667ade7c-2fcf-4d76-a122-e1028639a6c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8] added
Nov 02 12:56:39 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0e8ed7-8ad9-4d54-9a05-f0f26a34a296]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5edde73-60b5-4fec-9c08-1c010fb05d20]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjRVaWOk {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:39 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjRVaWOk" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e562fa-c261-46d9-bf5e-265f168478e0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjRVaWOk'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eecfb9-da5f-48c5-83c5-64f951d9801f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aadc448-fa36-4e1d-a73f-9a0ff519edd5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:56:40 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 12:56:40 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:56:40 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 12:56:40 user nova-compute[74534]: 
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de8b1d3-82e1-4996-b0f1-b44ba5f65919]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]
Nov 02 12:56:40 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.
Nov 02 12:56:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d44132-1dab-4aa8-9794-72b1f759cf4b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4fca2c-9aea-4921-9b74-a5e6ec6e8996]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:56:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:56:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.104s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc0a50-c3cf-4ac7-a505-1e1a58994dd9]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:56:40 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23232633861623736', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232633861623736', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-638739562',display_name='tempest-TestVolumeBootPattern-server-638739562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-638739562',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-hn5re4w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:56:21Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=43593bfe-6a5f-434a-903b-4a2d44bcda0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7a:b0,bridge_name='br-int',has_traffic_filtering=True,id=f6bc3818-0588-40a6-a855-f642ec909ee7,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6bc3818-05') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.objects.instance [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'pci_devices' on Instance uuid 43593bfe-6a5f-434a-903b-4a2d44bcda0c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:56:41 user nova-compute[74534]:   <uuid>43593bfe-6a5f-434a-903b-4a2d44bcda0c</uuid>
Nov 02 12:56:41 user nova-compute[74534]:   <name>instance-00000032</name>
Nov 02 12:56:41 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:56:41 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:56:41 user nova-compute[74534]:   <metadata>
Nov 02 12:56:41 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:56:41 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:56:41 user nova-compute[74534]:       <nova:name>tempest-TestVolumeBootPattern-server-638739562</nova:name>
Nov 02 12:56:41 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:56:39</nova:creationTime>
Nov 02 12:56:41 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:56:41 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:56:41 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:56:41 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:56:41 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:56:41 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:56:41 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:56:41 user nova-compute[74534]:       <nova:owner>
Nov 02 12:56:41 user nova-compute[74534]:         <nova:user uuid="0c6f47ffa03e4eb1a8e70de2b66a47b6">tempest-TestVolumeBootPattern-1985560946-project-member</nova:user>
Nov 02 12:56:41 user nova-compute[74534]:         <nova:project uuid="a892f774d6074fc1b0eb752e802efb5b">tempest-TestVolumeBootPattern-1985560946</nova:project>
Nov 02 12:56:41 user nova-compute[74534]:       </nova:owner>
Nov 02 12:56:41 user nova-compute[74534]:       <nova:ports>
Nov 02 12:56:41 user nova-compute[74534]:         <nova:port uuid="f6bc3818-0588-40a6-a855-f642ec909ee7">
Nov 02 12:56:41 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 12:56:41 user nova-compute[74534]:         </nova:port>
Nov 02 12:56:41 user nova-compute[74534]:       </nova:ports>
Nov 02 12:56:41 user nova-compute[74534]:     </nova:instance>
Nov 02 12:56:41 user nova-compute[74534]:   </metadata>
Nov 02 12:56:41 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:56:41 user nova-compute[74534]:     <system>
Nov 02 12:56:41 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:56:41 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:56:41 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:56:41 user nova-compute[74534]:       <entry name="serial">43593bfe-6a5f-434a-903b-4a2d44bcda0c</entry>
Nov 02 12:56:41 user nova-compute[74534]:       <entry name="uuid">43593bfe-6a5f-434a-903b-4a2d44bcda0c</entry>
Nov 02 12:56:41 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:56:41 user nova-compute[74534]:     </system>
Nov 02 12:56:41 user nova-compute[74534]:   </sysinfo>
Nov 02 12:56:41 user nova-compute[74534]:   <os>
Nov 02 12:56:41 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:56:41 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:56:41 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:56:41 user nova-compute[74534]:   </os>
Nov 02 12:56:41 user nova-compute[74534]:   <features>
Nov 02 12:56:41 user nova-compute[74534]:     <acpi/>
Nov 02 12:56:41 user nova-compute[74534]:     <apic/>
Nov 02 12:56:41 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:56:41 user nova-compute[74534]:   </features>
Nov 02 12:56:41 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:56:41 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:56:41 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:56:41 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:56:41 user nova-compute[74534]:   </clock>
Nov 02 12:56:41 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:56:41 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:56:41 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:56:41 user nova-compute[74534]:   </cpu>
Nov 02 12:56:41 user nova-compute[74534]:   <devices>
Nov 02 12:56:41 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:56:41 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:56:41 user nova-compute[74534]:       <source dev="/dev/sdb"/>
Nov 02 12:56:41 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:56:41 user nova-compute[74534]:       <serial>0f3b009e-d56e-49f5-859b-df3b31ad6ae8</serial>
Nov 02 12:56:41 user nova-compute[74534]:     </disk>
Nov 02 12:56:41 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:56:41 user nova-compute[74534]:       <mac address="fa:16:3e:f9:7a:b0"/>
Nov 02 12:56:41 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:56:41 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:56:41 user nova-compute[74534]:       <target dev="tapf6bc3818-05"/>
Nov 02 12:56:41 user nova-compute[74534]:     </interface>
Nov 02 12:56:41 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:56:41 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/43593bfe-6a5f-434a-903b-4a2d44bcda0c/console.log" append="off"/>
Nov 02 12:56:41 user nova-compute[74534]:     </serial>
Nov 02 12:56:41 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:56:41 user nova-compute[74534]:     <video>
Nov 02 12:56:41 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:56:41 user nova-compute[74534]:     </video>
Nov 02 12:56:41 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:56:41 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:56:41 user nova-compute[74534]:     </rng>
Nov 02 12:56:41 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:56:41 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:56:41 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:56:41 user nova-compute[74534]:     </memballoon>
Nov 02 12:56:41 user nova-compute[74534]:   </devices>
Nov 02 12:56:41 user nova-compute[74534]: </domain>
Nov 02 12:56:41 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-638739562',display_name='tempest-TestVolumeBootPattern-server-638739562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-638739562',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-hn5re4w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:56:21Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=43593bfe-6a5f-434a-903b-4a2d44bcda0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7a:b0,bridge_name='br-int',has_traffic_filtering=True,id=f6bc3818-0588-40a6-a855-f642ec909ee7,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6bc3818-05') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG os_vif [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7a:b0,bridge_name='br-int',has_traffic_filtering=True,id=f6bc3818-0588-40a6-a855-f642ec909ee7,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6bc3818-05') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9123020a-a4aa-5cea-9be2-e7f441bb197b', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6bc3818-05, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6bc3818-05, col_values=(('qos', UUID('6149b050-13e2-4b62-99bc-73c932eef25f')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6bc3818-05, col_values=(('external_ids', {'iface-id': 'f6bc3818-0588-40a6-a855-f642ec909ee7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:7a:b0', 'vm-uuid': '43593bfe-6a5f-434a-903b-4a2d44bcda0c'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:41 user nova-compute[74534]: INFO os_vif [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:7a:b0,bridge_name='br-int',has_traffic_filtering=True,id=f6bc3818-0588-40a6-a855-f642ec909ee7,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6bc3818-05')
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:56:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No VIF found with MAC fa:16:3e:f9:7a:b0, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-e2e76940-685c-452c-9bb2-86f8a4136f8b req-5c6e8b12-053d-4f34-a5e2-52f6d207b550 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e2e76940-685c-452c-9bb2-86f8a4136f8b req-5c6e8b12-053d-4f34-a5e2-52f6d207b550 service nova] Acquiring lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e2e76940-685c-452c-9bb2-86f8a4136f8b req-5c6e8b12-053d-4f34-a5e2-52f6d207b550 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-e2e76940-685c-452c-9bb2-86f8a4136f8b req-5c6e8b12-053d-4f34-a5e2-52f6d207b550 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:56:42 user nova-compute[74534]: DEBUG nova.compute.manager [req-e2e76940-685c-452c-9bb2-86f8a4136f8b req-5c6e8b12-053d-4f34-a5e2-52f6d207b550 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] No waiting events found dispatching network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:56:42 user nova-compute[74534]: WARNING nova.compute.manager [req-e2e76940-685c-452c-9bb2-86f8a4136f8b req-5c6e8b12-053d-4f34-a5e2-52f6d207b550 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received unexpected event network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 for instance with vm_state building and task_state spawning.
Nov 02 12:56:42 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:56:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Instance spawned successfully.
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:56:44 user nova-compute[74534]: INFO nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:56:44 user nova-compute[74534]: INFO nova.compute.manager [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Took 23.98 seconds to build instance.
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-a23daaf1-59ae-444c-8ba1-2da98c055931 req-5e41ef6c-333a-4474-bd3f-25429b1734f9 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a23daaf1-59ae-444c-8ba1-2da98c055931 req-5e41ef6c-333a-4474-bd3f-25429b1734f9 service nova] Acquiring lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a23daaf1-59ae-444c-8ba1-2da98c055931 req-5e41ef6c-333a-4474-bd3f-25429b1734f9 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a23daaf1-59ae-444c-8ba1-2da98c055931 req-5e41ef6c-333a-4474-bd3f-25429b1734f9 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:56:44 user nova-compute[74534]: DEBUG nova.compute.manager [req-a23daaf1-59ae-444c-8ba1-2da98c055931 req-5e41ef6c-333a-4474-bd3f-25429b1734f9 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] No waiting events found dispatching network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:56:44 user nova-compute[74534]: WARNING nova.compute.manager [req-a23daaf1-59ae-444c-8ba1-2da98c055931 req-5e41ef6c-333a-4474-bd3f-25429b1734f9 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received unexpected event network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 for instance with vm_state active and task_state None.
Nov 02 12:56:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-d19f0ec0-b602-447a-983c-ee9189c7118a tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.075s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:56:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:47 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:56:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:56:48 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9059MB free_disk=24.92357635498047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 43593bfe-6a5f-434a-903b-4a2d44bcda0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:56:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:56:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:56:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:56:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 12:57:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 12:57:05 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 12:57:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:57:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:57:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:57:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:57:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:57:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:57:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:57:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:57:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:57:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:57:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:57:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:57:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:34 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:57:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:57:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 43593bfe-6a5f-434a-903b-4a2d44bcda0c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:57:42 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:57:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:57:47 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:57:50 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:57:50 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=24.92292022705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 43593bfe-6a5f-434a-903b-4a2d44bcda0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:57:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:57:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:57:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:57:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:58:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:58:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:58:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-changed-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG nova.compute.manager [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Refreshing instance network info cache due to event network-changed-f6bc3818-0588-40a6-a855-f642ec909ee7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] Acquiring lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] Acquired lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Refreshing network info cache for port f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updated VIF entry in instance network info cache for port f6bc3818-0588-40a6-a855-f642ec909ee7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG nova.network.neutron [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:58:12 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-66c53406-c583-42a3-943c-68fcb4d734f8 req-55e6abd9-a7e4-467a-9abf-58b1590b4b82 service nova] Releasing lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:58:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "ca070d7e-8260-4c46-9720-4c98d2e27e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:58:29 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 12:58:30 user nova-compute[74534]: INFO nova.compute.claims [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Claim successful on node user
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 12:58:30 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 12:58:30 user nova-compute[74534]: INFO nova.virt.block_device [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Booting with volume f6f47971-afdb-42cb-8f61-df870719a47e at /dev/vda
Nov 02 12:58:30 user nova-compute[74534]: DEBUG os_brick.utils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b710cb1a-4f99-4516-8dc6-7971a74e1fdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f1c100-f138-4116-a55e-3c4a480b0f73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1675fea1-bf3f-407e-9b77-8c5f5af4d3e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530af0c-7dfd-4a66-8b45-f024a35ba9e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.policy [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6f47ffa03e4eb1a8e70de2b66a47b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892f774d6074fc1b0eb752e802efb5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 12:58:30 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 12:58:30 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c219964-58c7-428d-a799-2d4ac4703afe]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG os_brick.utils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:58:30 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updating existing volume attachment record: 631cae36-68af-4e1c-ad1a-92664c5665fb {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 12:58:31 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Successfully created port: 5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 12:58:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:31 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Successfully updated port: 5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 12:58:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:58:31 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquired lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:58:31 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-changed-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG nova.compute.manager [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Refreshing instance network info cache due to event network-changed-5f9ab70e-2a29-45b5-bb9c-527eedcee767. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] Acquiring lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG nova.network.neutron [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updating instance_info_cache with network_info: [{"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Releasing lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Instance network_info: |[{"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] Acquired lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:58:32 user nova-compute[74534]: DEBUG nova.network.neutron [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Refreshing network info cache for port 5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 12:58:33 user nova-compute[74534]: DEBUG nova.network.neutron [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updated VIF entry in instance network info cache for port 5f9ab70e-2a29-45b5-bb9c-527eedcee767. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 12:58:33 user nova-compute[74534]: DEBUG nova.network.neutron [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updating instance_info_cache with network_info: [{"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:58:33 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-2fb5f7a6-04d4-4ff1-833f-5d4c51346d34 req-81786f10-12bf-4a72-8cda-20c2c35fdec2 service nova] Releasing lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:58:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:36 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:58:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:58:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:58:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:58:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Skipping network cache update for instance because it is Building. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 43593bfe-6a5f-434a-903b-4a2d44bcda0c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:58:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:58:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 12:58:49 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Creating image(s)
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Did not create local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Ensure instance console log exists: /opt/stack/data/nova/instances/ca070d7e-8260-4c46-9720-4c98d2e27e99/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Start _get_guest_xml network_info=[{"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'guest_format': None, 'attachment_id': '631cae36-68af-4e1c-ad1a-92664c5665fb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNewcHLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca070d7e-8260-4c46-9720-4c98d2e27e99', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6f47971-afdb-42cb-8f61-df870719a47e', 'serial': 'f6f47971-afdb-42cb-8f61-df870719a47e'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 12:58:49 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:58:49 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNewcHLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 12:58:49 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:58:49 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 12:58:49 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a68c989-cdfe-454e-af18-4d260a6ca820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 12:58:49 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c5a089-8577-4c9f-a126-98e448d0bfd7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e] added
Nov 02 12:58:49 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a23754-57f7-46cf-a659-eaedcdb1272d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd574a6-7a4b-403b-b6bf-933ff5f43c97]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNewcHLY {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNewcHLY" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec1781-e3a8-481b-9a27-56dd75265ace]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNewcHLY'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a69e437-b012-4c3d-98f7-ee8d9d88eaa5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2168e2d-2df5-4e05-bd5d-2882f4b50c97]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:58:49 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:58:49 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ac28e-596d-43db-8140-d9809c9b1ec5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260]
Nov 02 12:58:49 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260] successful.
Nov 02 12:58:49 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2c91c1-7b52-4430-adb2-9ac837246201]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d728da-c7ab-41eb-81c8-03245273d22b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:58:49 user nova-compute[74534]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e (non-flash)
Nov 02 12:58:49 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 12:58:49 user nova-compute[74534]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e (non-flash)
Nov 02 12:58:49 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f928be9-3bef-49fb-b74e-64da07748913]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 12:58:49 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNewcHLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26637333861623334', 'path': '/dev/sdc'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637333861623334', 'path': '/dev/sdc'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1523833706',display_name='tempest-TestVolumeBootPattern-server-1523833706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1523833706',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-0luco4ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:58:30Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=ca070d7e-8260-4c46-9720-4c98d2e27e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:61:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9ab70e-2a29-45b5-bb9c-527eedcee767,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9ab70e-2a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.objects.instance [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'pci_devices' on Instance uuid ca070d7e-8260-4c46-9720-4c98d2e27e99 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] End _get_guest_xml xml=<domain type="kvm">
Nov 02 12:58:50 user nova-compute[74534]:   <uuid>ca070d7e-8260-4c46-9720-4c98d2e27e99</uuid>
Nov 02 12:58:50 user nova-compute[74534]:   <name>instance-00000033</name>
Nov 02 12:58:50 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 12:58:50 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 12:58:50 user nova-compute[74534]:   <metadata>
Nov 02 12:58:50 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 12:58:50 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 12:58:50 user nova-compute[74534]:       <nova:name>tempest-TestVolumeBootPattern-server-1523833706</nova:name>
Nov 02 12:58:50 user nova-compute[74534]:       <nova:creationTime>2023-11-02 12:58:49</nova:creationTime>
Nov 02 12:58:50 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 12:58:50 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 12:58:50 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 12:58:50 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 12:58:50 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 12:58:50 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 12:58:50 user nova-compute[74534]:       </nova:flavor>
Nov 02 12:58:50 user nova-compute[74534]:       <nova:owner>
Nov 02 12:58:50 user nova-compute[74534]:         <nova:user uuid="0c6f47ffa03e4eb1a8e70de2b66a47b6">tempest-TestVolumeBootPattern-1985560946-project-member</nova:user>
Nov 02 12:58:50 user nova-compute[74534]:         <nova:project uuid="a892f774d6074fc1b0eb752e802efb5b">tempest-TestVolumeBootPattern-1985560946</nova:project>
Nov 02 12:58:50 user nova-compute[74534]:       </nova:owner>
Nov 02 12:58:50 user nova-compute[74534]:       <nova:ports>
Nov 02 12:58:50 user nova-compute[74534]:         <nova:port uuid="5f9ab70e-2a29-45b5-bb9c-527eedcee767">
Nov 02 12:58:50 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 12:58:50 user nova-compute[74534]:         </nova:port>
Nov 02 12:58:50 user nova-compute[74534]:       </nova:ports>
Nov 02 12:58:50 user nova-compute[74534]:     </nova:instance>
Nov 02 12:58:50 user nova-compute[74534]:   </metadata>
Nov 02 12:58:50 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 12:58:50 user nova-compute[74534]:     <system>
Nov 02 12:58:50 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 12:58:50 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 12:58:50 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 12:58:50 user nova-compute[74534]:       <entry name="serial">ca070d7e-8260-4c46-9720-4c98d2e27e99</entry>
Nov 02 12:58:50 user nova-compute[74534]:       <entry name="uuid">ca070d7e-8260-4c46-9720-4c98d2e27e99</entry>
Nov 02 12:58:50 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 12:58:50 user nova-compute[74534]:     </system>
Nov 02 12:58:50 user nova-compute[74534]:   </sysinfo>
Nov 02 12:58:50 user nova-compute[74534]:   <os>
Nov 02 12:58:50 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 12:58:50 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 12:58:50 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 12:58:50 user nova-compute[74534]:   </os>
Nov 02 12:58:50 user nova-compute[74534]:   <features>
Nov 02 12:58:50 user nova-compute[74534]:     <acpi/>
Nov 02 12:58:50 user nova-compute[74534]:     <apic/>
Nov 02 12:58:50 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 12:58:50 user nova-compute[74534]:   </features>
Nov 02 12:58:50 user nova-compute[74534]:   <clock offset="utc">
Nov 02 12:58:50 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 12:58:50 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 12:58:50 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 12:58:50 user nova-compute[74534]:   </clock>
Nov 02 12:58:50 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 12:58:50 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 12:58:50 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 12:58:50 user nova-compute[74534]:   </cpu>
Nov 02 12:58:50 user nova-compute[74534]:   <devices>
Nov 02 12:58:50 user nova-compute[74534]:     <disk type="block" device="disk">
Nov 02 12:58:50 user nova-compute[74534]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 12:58:50 user nova-compute[74534]:       <source dev="/dev/sdc"/>
Nov 02 12:58:50 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 12:58:50 user nova-compute[74534]:       <serial>f6f47971-afdb-42cb-8f61-df870719a47e</serial>
Nov 02 12:58:50 user nova-compute[74534]:     </disk>
Nov 02 12:58:50 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 12:58:50 user nova-compute[74534]:       <mac address="fa:16:3e:86:61:64"/>
Nov 02 12:58:50 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:58:50 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 12:58:50 user nova-compute[74534]:       <target dev="tap5f9ab70e-2a"/>
Nov 02 12:58:50 user nova-compute[74534]:     </interface>
Nov 02 12:58:50 user nova-compute[74534]:     <serial type="pty">
Nov 02 12:58:50 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/ca070d7e-8260-4c46-9720-4c98d2e27e99/console.log" append="off"/>
Nov 02 12:58:50 user nova-compute[74534]:     </serial>
Nov 02 12:58:50 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 12:58:50 user nova-compute[74534]:     <video>
Nov 02 12:58:50 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 12:58:50 user nova-compute[74534]:     </video>
Nov 02 12:58:50 user nova-compute[74534]:     <rng model="virtio">
Nov 02 12:58:50 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 12:58:50 user nova-compute[74534]:     </rng>
Nov 02 12:58:50 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 12:58:50 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 12:58:50 user nova-compute[74534]:       <stats period="10"/>
Nov 02 12:58:50 user nova-compute[74534]:     </memballoon>
Nov 02 12:58:50 user nova-compute[74534]:   </devices>
Nov 02 12:58:50 user nova-compute[74534]: </domain>
Nov 02 12:58:50 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1523833706',display_name='tempest-TestVolumeBootPattern-server-1523833706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1523833706',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-0luco4ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T12:58:30Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=ca070d7e-8260-4c46-9720-4c98d2e27e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:61:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9ab70e-2a29-45b5-bb9c-527eedcee767,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9ab70e-2a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG os_vif [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:61:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9ab70e-2a29-45b5-bb9c-527eedcee767,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9ab70e-2a') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef4c012b-ddd5-510d-b1ea-e8130a53cc87', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9ab70e-2a, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f9ab70e-2a, col_values=(('qos', UUID('479a70bb-bc09-44df-b25c-e4dc2f9f1014')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f9ab70e-2a, col_values=(('external_ids', {'iface-id': '5f9ab70e-2a29-45b5-bb9c-527eedcee767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:61:64', 'vm-uuid': 'ca070d7e-8260-4c46-9720-4c98d2e27e99'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:50 user nova-compute[74534]: INFO os_vif [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:61:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9ab70e-2a29-45b5-bb9c-527eedcee767,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9ab70e-2a')
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 12:58:50 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] No VIF found with MAC fa:16:3e:86:61:64, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-a36c9af3-7d72-442d-abab-fcf5009ace89 req-6303e6c7-04a6-494b-a024-cb20692a0e2c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a36c9af3-7d72-442d-abab-fcf5009ace89 req-6303e6c7-04a6-494b-a024-cb20692a0e2c service nova] Acquiring lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a36c9af3-7d72-442d-abab-fcf5009ace89 req-6303e6c7-04a6-494b-a024-cb20692a0e2c service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a36c9af3-7d72-442d-abab-fcf5009ace89 req-6303e6c7-04a6-494b-a024-cb20692a0e2c service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG nova.compute.manager [req-a36c9af3-7d72-442d-abab-fcf5009ace89 req-6303e6c7-04a6-494b-a024-cb20692a0e2c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] No waiting events found dispatching network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:58:52 user nova-compute[74534]: WARNING nova.compute.manager [req-a36c9af3-7d72-442d-abab-fcf5009ace89 req-6303e6c7-04a6-494b-a024-cb20692a0e2c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received unexpected event network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 for instance with vm_state building and task_state spawning.
Nov 02 12:58:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:58:52 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 12:58:54 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Instance spawned successfully.
Nov 02 12:58:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:58:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=24.92157745361328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-ed903315-d89e-4ccd-a06e-f59c13969066 req-6d98bef4-1ff0-4970-b48a-9658359c9df5 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ed903315-d89e-4ccd-a06e-f59c13969066 req-6d98bef4-1ff0-4970-b48a-9658359c9df5 service nova] Acquiring lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ed903315-d89e-4ccd-a06e-f59c13969066 req-6d98bef4-1ff0-4970-b48a-9658359c9df5 service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ed903315-d89e-4ccd-a06e-f59c13969066 req-6d98bef4-1ff0-4970-b48a-9658359c9df5 service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.manager [req-ed903315-d89e-4ccd-a06e-f59c13969066 req-6d98bef4-1ff0-4970-b48a-9658359c9df5 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] No waiting events found dispatching network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 12:58:54 user nova-compute[74534]: WARNING nova.compute.manager [req-ed903315-d89e-4ccd-a06e-f59c13969066 req-6d98bef4-1ff0-4970-b48a-9658359c9df5 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received unexpected event network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 for instance with vm_state building and task_state spawning.
Nov 02 12:58:54 user nova-compute[74534]: INFO nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:54 user nova-compute[74534]: INFO nova.compute.manager [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Took 24.56 seconds to build instance.
Nov 02 12:58:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-b79ba05f-e630-4d33-a771-3b7ced088f47 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.658s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 43593bfe-6a5f-434a-903b-4a2d44bcda0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ca070d7e-8260-4c46-9720-4c98d2e27e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:58:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:58:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:58:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:04 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:59:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:59:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:59:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:38 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 12:59:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 43593bfe-6a5f-434a-903b-4a2d44bcda0c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 12:59:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 12:59:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:59:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:59:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 12:59:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 12:59:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:59:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 12:59:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 12:59:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 12:59:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:59:54 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=24.920391082763672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 43593bfe-6a5f-434a-903b-4a2d44bcda0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance ca070d7e-8260-4c46-9720-4c98d2e27e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 12:59:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 12:59:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:00:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-changed-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:00:21 user nova-compute[74534]: DEBUG nova.compute.manager [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Refreshing instance network info cache due to event network-changed-5f9ab70e-2a29-45b5-bb9c-527eedcee767. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 13:00:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] Acquiring lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:00:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] Acquired lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:00:21 user nova-compute[74534]: DEBUG nova.network.neutron [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Refreshing network info cache for port 5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updated VIF entry in instance network info cache for port 5f9ab70e-2a29-45b5-bb9c-527eedcee767. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG nova.network.neutron [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updating instance_info_cache with network_info: [{"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-9dc39d68-2120-477e-81fc-64c438621a46 req-3bf9e6ce-3e21-4a18-bcc6-4aa899a6030c service nova] Releasing lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "ca070d7e-8260-4c46-9720-4c98d2e27e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:00:22 user nova-compute[74534]: INFO nova.compute.manager [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Terminating instance
Nov 02 13:00:22 user nova-compute[74534]: DEBUG nova.compute.manager [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:22 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-3fe7df90-18f3-46e3-840e-765609af9617 req-6f2bda3b-732b-4985-b7a6-a3447d8e4701 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-vif-unplugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3fe7df90-18f3-46e3-840e-765609af9617 req-6f2bda3b-732b-4985-b7a6-a3447d8e4701 service nova] Acquiring lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3fe7df90-18f3-46e3-840e-765609af9617 req-6f2bda3b-732b-4985-b7a6-a3447d8e4701 service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-3fe7df90-18f3-46e3-840e-765609af9617 req-6f2bda3b-732b-4985-b7a6-a3447d8e4701 service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-3fe7df90-18f3-46e3-840e-765609af9617 req-6f2bda3b-732b-4985-b7a6-a3447d8e4701 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] No waiting events found dispatching network-vif-unplugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-3fe7df90-18f3-46e3-840e-765609af9617 req-6f2bda3b-732b-4985-b7a6-a3447d8e4701 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-vif-unplugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Instance destroyed successfully.
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.objects.instance [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'resources' on Instance uuid ca070d7e-8260-4c46-9720-4c98d2e27e99 {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1523833706',display_name='tempest-TestVolumeBootPattern-server-1523833706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1523833706',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:58:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-0luco4ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:58:55Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=ca070d7e-8260-4c46-9720-4c98d2e27e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:61:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9ab70e-2a29-45b5-bb9c-527eedcee767,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9ab70e-2a') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_vif [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:61:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9ab70e-2a29-45b5-bb9c-527eedcee767,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9ab70e-2a') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9ab70e-2a, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=479a70bb-bc09-44df-b25c-e4dc2f9f1014) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:00:23 user nova-compute[74534]: INFO os_vif [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:61:64,bridge_name='br-int',has_traffic_filtering=True,id=5f9ab70e-2a29-45b5-bb9c-527eedcee767,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9ab70e-2a')
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNewcHLY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:00:23 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[98da6dbc-9cbf-4138-bcc9-b0e2ae9cd98e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 13:00:23 user nova-compute[74534]: No targets found.
Nov 02 13:00:23 user nova-compute[74534]: iSNS:
Nov 02 13:00:23 user nova-compute[74534]: No targets found.
Nov 02 13:00:23 user nova-compute[74534]: STATIC:
Nov 02 13:00:23 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8
Nov 02 13:00:23 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 13:00:23 user nova-compute[74534]:                 Iface Name: default
Nov 02 13:00:23 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e
Nov 02 13:00:23 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 13:00:23 user nova-compute[74534]:                 Iface Name: default
Nov 02 13:00:23 user nova-compute[74534]: FIRMWARE:
Nov 02 13:00:23 user nova-compute[74534]: No targets found.
Nov 02 13:00:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 13:00:23 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 13:00:23 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[131364cd-c2fe-4907-8613-8b39624bb86c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a5005b-e5e4-43a5-a6aa-e2444bb3470c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 13:00:23 user nova-compute[74534]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e (non-flash)
Nov 02 13:00:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 13:00:23 user nova-compute[74534]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e (non-flash)
Nov 02 13:00:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe1804c79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e'): ({'sdc'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Removing single pathed devices sdc {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16387027-286a-49c0-a9fc-58f9937a72bf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398aabc-c1b6-4284-a505-789a48e1bc02]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flushing IO for device /dev/sdc {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efede54-0fbb-4e18-99b3-28a14626b23a]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc736da2-eea5-40fe-a1c4-6477d3332575]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] SCSI volumes sdc have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fb13c85a', '/dev/disk/by-id/scsi-1SCST_BIOfb13c85a-f738ab347867e430', '/dev/disk/by-id/scsi-26637333861623334') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a3e4c5-f709-49a6-8e77-092ab8035b40]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cfa08f-51d2-4579-a561-8187ae1a2bb7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-changed-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.compute.manager [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Refreshing instance network info cache due to event network-changed-5f9ab70e-2a29-45b5-bb9c-527eedcee767. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] Acquiring lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] Acquired lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG nova.network.neutron [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Refreshing network info cache for port 5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3335f2a5-edf8-48f7-96bd-81d2e0e8a653]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260]
Nov 02 13:00:23 user nova-compute[74534]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e, portal: 172.16.0.220,3260] successful.
Nov 02 13:00:23 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f47971-afdb-42cb-8f61-df870719a47e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[affb5383-9ce5-41d1-85cd-ff27627cd2b8]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:00:23 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== disconnect_volume: return (304ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 13:00:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Deleting instance files /opt/stack/data/nova/instances/ca070d7e-8260-4c46-9720-4c98d2e27e99_del
Nov 02 13:00:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Deletion of /opt/stack/data/nova/instances/ca070d7e-8260-4c46-9720-4c98d2e27e99_del complete
Nov 02 13:00:24 user nova-compute[74534]: INFO nova.compute.manager [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 02 13:00:24 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG nova.network.neutron [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updated VIF entry in instance network info cache for port 5f9ab70e-2a29-45b5-bb9c-527eedcee767. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG nova.network.neutron [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updating instance_info_cache with network_info: [{"id": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "address": "fa:16:3e:86:61:64", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9ab70e-2a", "ovs_interfaceid": "5f9ab70e-2a29-45b5-bb9c-527eedcee767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d8a85130-2060-49cd-9f02-070254798e83 req-2b1dca0c-3408-423b-9be5-1713555ed8e2 service nova] Releasing lock "refresh_cache-ca070d7e-8260-4c46-9720-4c98d2e27e99" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:24 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:00:24 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Took 0.61 seconds to deallocate network for instance.
Nov 02 13:00:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-97e16d14-3ecd-4890-882e-9fc1cfb8a6cf req-1b33bcba-9029-4f98-b826-db4cb99d821c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-97e16d14-3ecd-4890-882e-9fc1cfb8a6cf req-1b33bcba-9029-4f98-b826-db4cb99d821c service nova] Acquiring lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-97e16d14-3ecd-4890-882e-9fc1cfb8a6cf req-1b33bcba-9029-4f98-b826-db4cb99d821c service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-97e16d14-3ecd-4890-882e-9fc1cfb8a6cf req-1b33bcba-9029-4f98-b826-db4cb99d821c service nova] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-97e16d14-3ecd-4890-882e-9fc1cfb8a6cf req-1b33bcba-9029-4f98-b826-db4cb99d821c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] No waiting events found dispatching network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:00:25 user nova-compute[74534]: WARNING nova.compute.manager [req-97e16d14-3ecd-4890-882e-9fc1cfb8a6cf req-1b33bcba-9029-4f98-b826-db4cb99d821c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received unexpected event network-vif-plugged-5f9ab70e-2a29-45b5-bb9c-527eedcee767 for instance with vm_state active and task_state deleting.
Nov 02 13:00:25 user nova-compute[74534]: DEBUG nova.compute.manager [req-97e16d14-3ecd-4890-882e-9fc1cfb8a6cf req-1b33bcba-9029-4f98-b826-db4cb99d821c service nova] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Received event network-vif-deleted-5f9ab70e-2a29-45b5-bb9c-527eedcee767 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:00:25 user nova-compute[74534]: INFO nova.compute.manager [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: ca070d7e-8260-4c46-9720-4c98d2e27e99] Took 0.90 seconds to detach 1 volumes for instance.
Nov 02 13:00:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:00:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:00:25 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Deleted allocations for instance ca070d7e-8260-4c46-9720-4c98d2e27e99
Nov 02 13:00:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-a7eced7d-9cfa-43d0-95e6-f73d99c45ee0 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "ca070d7e-8260-4c46-9720-4c98d2e27e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.136s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:00:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:00:36 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:39 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:39 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:00:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:00:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 13:00:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:00:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:00:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:00:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:00:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:00:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:00:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74534) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 13:00:56 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:00:56 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.91952133178711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 43593bfe-6a5f-434a-903b-4a2d44bcda0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:00:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:00:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:01:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:01:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:01:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:01:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:01:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:01:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-changed-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG nova.compute.manager [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Refreshing instance network info cache due to event network-changed-f6bc3818-0588-40a6-a855-f642ec909ee7. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] Acquiring lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] Acquired lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG nova.network.neutron [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Refreshing network info cache for port f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:01:35 user nova-compute[74534]: INFO nova.compute.manager [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Terminating instance
Nov 02 13:01:35 user nova-compute[74534]: DEBUG nova.compute.manager [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 13:01:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG nova.network.neutron [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updated VIF entry in instance network info cache for port f6bc3818-0588-40a6-a855-f642ec909ee7. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG nova.network.neutron [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [{"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-b7f03e29-4d00-4e73-bae5-9ad158498de1 req-e5e250b7-1c25-43b4-af36-f26241bb3ff5 service nova] Releasing lock "refresh_cache-43593bfe-6a5f-434a-903b-4a2d44bcda0c" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:01:36 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Instance destroyed successfully.
Nov 02 13:01:36 user nova-compute[74534]: DEBUG nova.objects.instance [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lazy-loading 'resources' on Instance uuid 43593bfe-6a5f-434a-903b-4a2d44bcda0c {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T12:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-638739562',display_name='tempest-TestVolumeBootPattern-server-638739562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-638739562',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFvpaDDV1A7MBADs/p1kvCETkwBnFkkbwa2ru+FDKmW3VR+ZDY6N0eexpPBQLvbo20xqDq0Uln7KH8pTOf5NDk9ZO586FRKzb9y/AacBplG4J0MGx2Z88VgQvrQQKEdkw==',key_name='tempest-TestVolumeBootPattern-631938858',keypairs=<?>,launch_index=0,launched_at=2023-11-02T12:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a892f774d6074fc1b0eb752e802efb5b',ramdisk_id='',reservation_id='r-hn5re4w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1985560946',owner_user_name='tempest-TestVolumeBootPattern-1985560946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T12:56:45Z,user_data=None,user_id='0c6f47ffa03e4eb1a8e70de2b66a47b6',uuid=43593bfe-6a5f-434a-903b-4a2d44bcda0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converting VIF {"id": "f6bc3818-0588-40a6-a855-f642ec909ee7", "address": "fa:16:3e:f9:7a:b0", "network": {"id": "bc277527-6e53-4483-a68a-584bacf00c45", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-944461164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a892f774d6074fc1b0eb752e802efb5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6bc3818-05", "ovs_interfaceid": "f6bc3818-0588-40a6-a855-f642ec909ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:7a:b0,bridge_name='br-int',has_traffic_filtering=True,id=f6bc3818-0588-40a6-a855-f642ec909ee7,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6bc3818-05') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_vif [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:7a:b0,bridge_name='br-int',has_traffic_filtering=True,id=f6bc3818-0588-40a6-a855-f642ec909ee7,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6bc3818-05') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6bc3818-05, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6149b050-13e2-4b62-99bc-73c932eef25f) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:01:36 user nova-compute[74534]: INFO os_vif [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:7a:b0,bridge_name='br-int',has_traffic_filtering=True,id=f6bc3818-0588-40a6-a855-f642ec909ee7,network=Network(bc277527-6e53-4483-a68a-584bacf00c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6bc3818-05')
Nov 02 13:01:36 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjRVaWOk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:01:36 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d682e6-e99e-4232-bf01-b8c7b5620e5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 13:01:36 user nova-compute[74534]: No targets found.
Nov 02 13:01:36 user nova-compute[74534]: iSNS:
Nov 02 13:01:36 user nova-compute[74534]: No targets found.
Nov 02 13:01:36 user nova-compute[74534]: STATIC:
Nov 02 13:01:36 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8
Nov 02 13:01:36 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 13:01:36 user nova-compute[74534]:                 Iface Name: default
Nov 02 13:01:36 user nova-compute[74534]: FIRMWARE:
Nov 02 13:01:36 user nova-compute[74534]: No targets found.
Nov 02 13:01:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 13:01:36 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 13:01:36 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[015d31b7-7688-4a7e-a8b8-d035779a6907]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[db86775b-4cdd-44e1-93a9-2ad856f42cc6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 13:01:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 (non-flash)
Nov 02 13:01:36 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180111a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8b2679-6889-40b1-aa8a-786df823d2bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bb0aaf-e7ed-4f36-942f-6ee157b44bf6]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874ec12-7f07-46ff-b289-c9c04cb5eb73]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23255e24-9ad1-4521-a959-074a14e87d65]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4119c0f6', '/dev/disk/by-id/scsi-23232633861623736', '/dev/disk/by-id/scsi-1SCST_BIO4119c0f6-22c8ab761f4f18ed') {{(pid=86346) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14a957-4763-4729-8e38-98ad07fd3cbf]: (4, None) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b04709-b252-4783-8996-867e472257c1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:01:36 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f7e2e-dd95-4641-b544-af17c2270a2b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260]
Nov 02 13:01:37 user nova-compute[74534]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8, portal: 172.16.0.220,3260] successful.
Nov 02 13:01:37 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f3b009e-d56e-49f5-859b-df3b31ad6ae8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[902bc6b1-78f3-48e3-8b52-721c3287922c]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] <== disconnect_volume: return (295ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 13:01:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Deleting instance files /opt/stack/data/nova/instances/43593bfe-6a5f-434a-903b-4a2d44bcda0c_del
Nov 02 13:01:37 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Deletion of /opt/stack/data/nova/instances/43593bfe-6a5f-434a-903b-4a2d44bcda0c_del complete
Nov 02 13:01:37 user nova-compute[74534]: INFO nova.compute.manager [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:01:37 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Took 0.46 seconds to deallocate network for instance.
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-29110b99-c3bb-4995-8718-b7547d72003d req-2525902a-54dd-435a-83cf-a18fb5261f92 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-vif-deleted-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:01:37 user nova-compute[74534]: INFO nova.compute.manager [req-29110b99-c3bb-4995-8718-b7547d72003d req-2525902a-54dd-435a-83cf-a18fb5261f92 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Neutron deleted interface f6bc3818-0588-40a6-a855-f642ec909ee7; detaching it from the instance and deleting it from the info cache
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.network.neutron [req-29110b99-c3bb-4995-8718-b7547d72003d req-2525902a-54dd-435a-83cf-a18fb5261f92 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-29110b99-c3bb-4995-8718-b7547d72003d req-2525902a-54dd-435a-83cf-a18fb5261f92 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Detach interface failed, port_id=f6bc3818-0588-40a6-a855-f642ec909ee7, reason: Instance 43593bfe-6a5f-434a-903b-4a2d44bcda0c could not be found. {{(pid=74534) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-vif-unplugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] Acquiring lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] No waiting events found dispatching network-vif-unplugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-vif-unplugged-f6bc3818-0588-40a6-a855-f642ec909ee7 for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received event network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] Acquiring lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:01:37 user nova-compute[74534]: DEBUG nova.compute.manager [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] No waiting events found dispatching network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:01:37 user nova-compute[74534]: WARNING nova.compute.manager [req-cda8849a-38cb-44d7-a41a-4f5c1c2588ac req-00e981a0-74e1-4fcd-975f-1a6303a58f33 service nova] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Received unexpected event network-vif-plugged-f6bc3818-0588-40a6-a855-f642ec909ee7 for instance with vm_state active and task_state deleting.
Nov 02 13:01:38 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:38 user nova-compute[74534]: INFO nova.compute.manager [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] [instance: 43593bfe-6a5f-434a-903b-4a2d44bcda0c] Took 1.01 seconds to detach 1 volumes for instance.
Nov 02 13:01:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:01:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:01:38 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:01:38 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:01:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:01:38 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Deleted allocations for instance 43593bfe-6a5f-434a-903b-4a2d44bcda0c
Nov 02 13:01:38 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-ec5dd386-fb94-49ff-9e9f-9ca4540229f5 tempest-TestVolumeBootPattern-1985560946 tempest-TestVolumeBootPattern-1985560946-project-member] Lock "43593bfe-6a5f-434a-903b-4a2d44bcda0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.929s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:01:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:41 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:01:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 13:01:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:47 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:01:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:01:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 13:01:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:01:57 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:01:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:01:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:01:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9109MB free_disk=24.918594360351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:01:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:02:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:02:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:02:09 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 13:02:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 13:02:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 13:02:11 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:02:16 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:19 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:21 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:02:26 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:27 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:31 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:33 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:36 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:40 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:41 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:43 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:02:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:46 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:47 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:02:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:02:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 13:02:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:51 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:52 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:56 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:57 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:02:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:02:58 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=24.91643524169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:02:58 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:02:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:02:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:01 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Starting instance... {{(pid=74534) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74534) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 13:03:02 user nova-compute[74534]: INFO nova.compute.claims [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Claim successful on node user
Nov 02 13:03:02 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Start building networks asynchronously for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Allocating IP information in the background. {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 13:03:02 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] allocate_for_instance() {{(pid=74534) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 13:03:03 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Start building block device mappings for instance. {{(pid=74534) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Start spawning the instance on the hypervisor. {{(pid=74534) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Creating instance directory {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 13:03:03 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Creating image(s)
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "/opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "/opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "/opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.policy [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8961284f2d94200ad9991a053a1d27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5a733dcbaa40ec93a8bc0fbacbfbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74534) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.169s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.178s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk 1073741824 {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe,backing_fmt=raw /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk 1073741824" returned: 0 in 0.047s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "8eafdd99856eea5f6f16814a3d78039f3d8ccafe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8eafdd99856eea5f6f16814a3d78039f3d8ccafe --force-share --output=json" returned: 0 in 0.172s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk. size=1073741824 {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Successfully created port: c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.virt.disk.api [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Cannot resize image /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk to a smaller size. {{(pid=74534) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Created local disks {{(pid=74534) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Ensure instance console log exists: /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/console.log {{(pid=74534) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Successfully updated port: c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Building network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-changed-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.compute.manager [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Refreshing instance network info cache due to event network-changed-c87f954e-9448-4fcb-a440-9ae6768158ba. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Instance cache missing network info. {{(pid=74534) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.neutron [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Instance network_info: |[{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74534) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.neutron [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Refreshing network info cache for port c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Start _get_guest_xml network_info=[{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '36642543-2106-4841-8acf-2e35b58c4209'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 13:03:04 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:03:04 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CPU controller missing on host. {{(pid=74534) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.host [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CPU controller found on host. {{(pid=74534) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74534) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T12:01:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T12:01:17Z,direct_url=<?>,disk_format='qcow2',id=36642543-2106-4841-8acf-2e35b58c4209,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c3c2302182984b2da11880efdba31eb9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T12:01:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Flavor limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Image limits 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Flavor pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Image pref 0:0:0 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Got 1 possible topologies {{(pid=74534) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.hardware [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74534) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T13:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1224254039',display_name='tempest-SnapshotDataIntegrityTests-server-1224254039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1224254039',id=52,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOR7LzVcnm95i4cUjJOltxUVWlyDr6cBCVAgBkb6uLs1mOPSJYexZtSZ2wCAtrPguJwI3VcdOm2Q/peHa9Zjs96EqjpQVQ9PyGdz8GHxVQph8E35lZLHQx2VaMZPlNE+rw==',key_name='tempest-keypair-1411596251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a5a733dcbaa40ec93a8bc0fbacbfbc9',ramdisk_id='',reservation_id='r-2j74gy1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1359978142',owner_user_name='tempest-SnapshotDataIntegrityTests-1359978142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T13:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8961284f2d94200ad9991a053a1d27b',uuid=566c5299-a99e-4fb2-a7e9-c64416067c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74534) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Converting VIF {"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d0:15,bridge_name='br-int',has_traffic_filtering=True,id=c87f954e-9448-4fcb-a440-9ae6768158ba,network=Network(2d15ad29-ec64-4b32-88b6-d024bcd86380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87f954e-94') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.objects.instance [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'pci_devices' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 13:03:04 user nova-compute[74534]:   <uuid>566c5299-a99e-4fb2-a7e9-c64416067c4b</uuid>
Nov 02 13:03:04 user nova-compute[74534]:   <name>instance-00000034</name>
Nov 02 13:03:04 user nova-compute[74534]:   <memory>524288</memory>
Nov 02 13:03:04 user nova-compute[74534]:   <vcpu>1</vcpu>
Nov 02 13:03:04 user nova-compute[74534]:   <metadata>
Nov 02 13:03:04 user nova-compute[74534]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 13:03:04 user nova-compute[74534]:       <nova:package version="0.0.0"/>
Nov 02 13:03:04 user nova-compute[74534]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1224254039</nova:name>
Nov 02 13:03:04 user nova-compute[74534]:       <nova:creationTime>2023-11-02 13:03:04</nova:creationTime>
Nov 02 13:03:04 user nova-compute[74534]:       <nova:flavor name="m1.tiny">
Nov 02 13:03:04 user nova-compute[74534]:         <nova:memory>512</nova:memory>
Nov 02 13:03:04 user nova-compute[74534]:         <nova:disk>1</nova:disk>
Nov 02 13:03:04 user nova-compute[74534]:         <nova:swap>0</nova:swap>
Nov 02 13:03:04 user nova-compute[74534]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 13:03:04 user nova-compute[74534]:         <nova:vcpus>1</nova:vcpus>
Nov 02 13:03:04 user nova-compute[74534]:       </nova:flavor>
Nov 02 13:03:04 user nova-compute[74534]:       <nova:owner>
Nov 02 13:03:04 user nova-compute[74534]:         <nova:user uuid="c8961284f2d94200ad9991a053a1d27b">tempest-SnapshotDataIntegrityTests-1359978142-project-member</nova:user>
Nov 02 13:03:04 user nova-compute[74534]:         <nova:project uuid="6a5a733dcbaa40ec93a8bc0fbacbfbc9">tempest-SnapshotDataIntegrityTests-1359978142</nova:project>
Nov 02 13:03:04 user nova-compute[74534]:       </nova:owner>
Nov 02 13:03:04 user nova-compute[74534]:       <nova:root type="image" uuid="36642543-2106-4841-8acf-2e35b58c4209"/>
Nov 02 13:03:04 user nova-compute[74534]:       <nova:ports>
Nov 02 13:03:04 user nova-compute[74534]:         <nova:port uuid="c87f954e-9448-4fcb-a440-9ae6768158ba">
Nov 02 13:03:04 user nova-compute[74534]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 13:03:04 user nova-compute[74534]:         </nova:port>
Nov 02 13:03:04 user nova-compute[74534]:       </nova:ports>
Nov 02 13:03:04 user nova-compute[74534]:     </nova:instance>
Nov 02 13:03:04 user nova-compute[74534]:   </metadata>
Nov 02 13:03:04 user nova-compute[74534]:   <sysinfo type="smbios">
Nov 02 13:03:04 user nova-compute[74534]:     <system>
Nov 02 13:03:04 user nova-compute[74534]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 13:03:04 user nova-compute[74534]:       <entry name="product">OpenStack Nova</entry>
Nov 02 13:03:04 user nova-compute[74534]:       <entry name="version">0.0.0</entry>
Nov 02 13:03:04 user nova-compute[74534]:       <entry name="serial">566c5299-a99e-4fb2-a7e9-c64416067c4b</entry>
Nov 02 13:03:04 user nova-compute[74534]:       <entry name="uuid">566c5299-a99e-4fb2-a7e9-c64416067c4b</entry>
Nov 02 13:03:04 user nova-compute[74534]:       <entry name="family">Virtual Machine</entry>
Nov 02 13:03:04 user nova-compute[74534]:     </system>
Nov 02 13:03:04 user nova-compute[74534]:   </sysinfo>
Nov 02 13:03:04 user nova-compute[74534]:   <os>
Nov 02 13:03:04 user nova-compute[74534]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 13:03:04 user nova-compute[74534]:     <boot dev="hd"/>
Nov 02 13:03:04 user nova-compute[74534]:     <smbios mode="sysinfo"/>
Nov 02 13:03:04 user nova-compute[74534]:   </os>
Nov 02 13:03:04 user nova-compute[74534]:   <features>
Nov 02 13:03:04 user nova-compute[74534]:     <acpi/>
Nov 02 13:03:04 user nova-compute[74534]:     <apic/>
Nov 02 13:03:04 user nova-compute[74534]:     <vmcoreinfo/>
Nov 02 13:03:04 user nova-compute[74534]:   </features>
Nov 02 13:03:04 user nova-compute[74534]:   <clock offset="utc">
Nov 02 13:03:04 user nova-compute[74534]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 13:03:04 user nova-compute[74534]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 13:03:04 user nova-compute[74534]:     <timer name="hpet" present="no"/>
Nov 02 13:03:04 user nova-compute[74534]:   </clock>
Nov 02 13:03:04 user nova-compute[74534]:   <cpu mode="custom" match="exact">
Nov 02 13:03:04 user nova-compute[74534]:     <model>Nehalem</model>
Nov 02 13:03:04 user nova-compute[74534]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 13:03:04 user nova-compute[74534]:   </cpu>
Nov 02 13:03:04 user nova-compute[74534]:   <devices>
Nov 02 13:03:04 user nova-compute[74534]:     <disk type="file" device="disk">
Nov 02 13:03:04 user nova-compute[74534]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 13:03:04 user nova-compute[74534]:       <source file="/opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk"/>
Nov 02 13:03:04 user nova-compute[74534]:       <target dev="vda" bus="virtio"/>
Nov 02 13:03:04 user nova-compute[74534]:     </disk>
Nov 02 13:03:04 user nova-compute[74534]:     <interface type="ethernet">
Nov 02 13:03:04 user nova-compute[74534]:       <mac address="fa:16:3e:ac:d0:15"/>
Nov 02 13:03:04 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 13:03:04 user nova-compute[74534]:       <mtu size="1442"/>
Nov 02 13:03:04 user nova-compute[74534]:       <target dev="tapc87f954e-94"/>
Nov 02 13:03:04 user nova-compute[74534]:     </interface>
Nov 02 13:03:04 user nova-compute[74534]:     <serial type="pty">
Nov 02 13:03:04 user nova-compute[74534]:       <log file="/opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/console.log" append="off"/>
Nov 02 13:03:04 user nova-compute[74534]:     </serial>
Nov 02 13:03:04 user nova-compute[74534]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 13:03:04 user nova-compute[74534]:     <video>
Nov 02 13:03:04 user nova-compute[74534]:       <model type="virtio"/>
Nov 02 13:03:04 user nova-compute[74534]:     </video>
Nov 02 13:03:04 user nova-compute[74534]:     <rng model="virtio">
Nov 02 13:03:04 user nova-compute[74534]:       <backend model="random">/dev/urandom</backend>
Nov 02 13:03:04 user nova-compute[74534]:     </rng>
Nov 02 13:03:04 user nova-compute[74534]:     <controller type="usb" index="0" model="none"/>
Nov 02 13:03:04 user nova-compute[74534]:     <memballoon model="virtio">
Nov 02 13:03:04 user nova-compute[74534]:       <stats period="10"/>
Nov 02 13:03:04 user nova-compute[74534]:     </memballoon>
Nov 02 13:03:04 user nova-compute[74534]:   </devices>
Nov 02 13:03:04 user nova-compute[74534]: </domain>
Nov 02 13:03:04 user nova-compute[74534]:  {{(pid=74534) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T13:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1224254039',display_name='tempest-SnapshotDataIntegrityTests-server-1224254039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1224254039',id=52,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOR7LzVcnm95i4cUjJOltxUVWlyDr6cBCVAgBkb6uLs1mOPSJYexZtSZ2wCAtrPguJwI3VcdOm2Q/peHa9Zjs96EqjpQVQ9PyGdz8GHxVQph8E35lZLHQx2VaMZPlNE+rw==',key_name='tempest-keypair-1411596251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a5a733dcbaa40ec93a8bc0fbacbfbc9',ramdisk_id='',reservation_id='r-2j74gy1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1359978142',owner_user_name='tempest-SnapshotDataIntegrityTests-1359978142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T13:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8961284f2d94200ad9991a053a1d27b',uuid=566c5299-a99e-4fb2-a7e9-c64416067c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Converting VIF {"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d0:15,bridge_name='br-int',has_traffic_filtering=True,id=c87f954e-9448-4fcb-a440-9ae6768158ba,network=Network(2d15ad29-ec64-4b32-88b6-d024bcd86380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87f954e-94') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG os_vif [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d0:15,bridge_name='br-int',has_traffic_filtering=True,id=c87f954e-9448-4fcb-a440-9ae6768158ba,network=Network(2d15ad29-ec64-4b32-88b6-d024bcd86380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87f954e-94') {{(pid=74534) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b146eba5-be91-5eac-abb1-f1ed62faf740', '_type': 'linux-noop'}}, row=False) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc87f954e-94, may_exist=True, interface_attrs={}) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc87f954e-94, col_values=(('qos', UUID('365ecabb-1d4e-460e-a598-701973f8ea72')),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc87f954e-94, col_values=(('external_ids', {'iface-id': 'c87f954e-9448-4fcb-a440-9ae6768158ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:d0:15', 'vm-uuid': '566c5299-a99e-4fb2-a7e9-c64416067c4b'}),), if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:04 user nova-compute[74534]: INFO os_vif [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:d0:15,bridge_name='br-int',has_traffic_filtering=True,id=c87f954e-9448-4fcb-a440-9ae6768158ba,network=Network(2d15ad29-ec64-4b32-88b6-d024bcd86380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87f954e-94')
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:03:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No VIF found with MAC fa:16:3e:ac:d0:15, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 13:03:05 user nova-compute[74534]: DEBUG nova.network.neutron [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated VIF entry in instance network info cache for port c87f954e-9448-4fcb-a440-9ae6768158ba. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 13:03:05 user nova-compute[74534]: DEBUG nova.network.neutron [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:03:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-30801473-8486-4958-83d5-0ad4a7b29bb8 req-f128ae58-971b-4396-aa9c-2961904899b7 service nova] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-5b380dbc-b8be-4411-b2a3-711084f4e375 req-3b57adce-7b4e-4b1f-9aa1-8b5e3e69408e service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5b380dbc-b8be-4411-b2a3-711084f4e375 req-3b57adce-7b4e-4b1f-9aa1-8b5e3e69408e service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5b380dbc-b8be-4411-b2a3-711084f4e375 req-3b57adce-7b4e-4b1f-9aa1-8b5e3e69408e service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-5b380dbc-b8be-4411-b2a3-711084f4e375 req-3b57adce-7b4e-4b1f-9aa1-8b5e3e69408e service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG nova.compute.manager [req-5b380dbc-b8be-4411-b2a3-711084f4e375 req-3b57adce-7b4e-4b1f-9aa1-8b5e3e69408e service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:03:06 user nova-compute[74534]: WARNING nova.compute.manager [req-5b380dbc-b8be-4411-b2a3-711084f4e375 req-3b57adce-7b4e-4b1f-9aa1-8b5e3e69408e service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received unexpected event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with vm_state building and task_state spawning.
Nov 02 13:03:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:06 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Instance event wait completed in 0 seconds for  {{(pid=74534) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Guest created on hypervisor {{(pid=74534) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 13:03:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Instance spawned successfully.
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Found default for hw_cdrom_bus of ide {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Found default for hw_disk_bus of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Found default for hw_input_bus of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Found default for hw_pointer_model of None {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Found default for hw_video_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Found default for hw_vif_model of virtio {{(pid=74534) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 13:03:08 user nova-compute[74534]: INFO nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Checking state {{(pid=74534) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 13:03:08 user nova-compute[74534]: INFO nova.compute.manager [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Took 5.81 seconds to build instance.
Nov 02 13:03:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-c3b117aa-308b-491b-9218-442ea12018c7 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.909s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-ea674d67-0f99-42dd-a71e-e8ab7a5ad4d7 req-651f6285-0a82-427f-bbbe-3416388c8a75 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea674d67-0f99-42dd-a71e-e8ab7a5ad4d7 req-651f6285-0a82-427f-bbbe-3416388c8a75 service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea674d67-0f99-42dd-a71e-e8ab7a5ad4d7 req-651f6285-0a82-427f-bbbe-3416388c8a75 service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-ea674d67-0f99-42dd-a71e-e8ab7a5ad4d7 req-651f6285-0a82-427f-bbbe-3416388c8a75 service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-ea674d67-0f99-42dd-a71e-e8ab7a5ad4d7 req-651f6285-0a82-427f-bbbe-3416388c8a75 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:03:08 user nova-compute[74534]: WARNING nova.compute.manager [req-ea674d67-0f99-42dd-a71e-e8ab7a5ad4d7 req-651f6285-0a82-427f-bbbe-3416388c8a75 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received unexpected event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with vm_state active and task_state None.
Nov 02 13:03:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:14 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:03:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:03:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:19 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:29 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:03:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:03:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:03:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:03:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:03:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:03:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:03:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:03:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:04:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:04:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.878917694091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:04:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:04:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:12 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:24 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:41 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:04:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:04:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:04:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:04:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:04:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:04:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-changed-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:04:53 user nova-compute[74534]: DEBUG nova.compute.manager [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Refreshing instance network info cache due to event network-changed-c87f954e-9448-4fcb-a440-9ae6768158ba. {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 13:04:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:04:53 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:04:53 user nova-compute[74534]: DEBUG nova.network.neutron [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Refreshing network info cache for port c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 13:04:54 user nova-compute[74534]: DEBUG nova.network.neutron [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated VIF entry in instance network info cache for port c87f954e-9448-4fcb-a440-9ae6768158ba. {{(pid=74534) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 13:04:54 user nova-compute[74534]: DEBUG nova.network.neutron [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:04:54 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-56611e20-c766-479a-a209-ed44437ef280 req-7e993cc9-6612-4de2-bb30-738b6be1c782 service nova] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:04:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:04:59 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:04:59 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:04:59 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.87810516357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:04:59 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:05:00 user nova-compute[74534]: INFO nova.compute.manager [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attaching volume c86fbaed-4361-499e-8f37-9f6b5bbb6b1d to /dev/vdb
Nov 02 13:05:00 user nova-compute[74534]: DEBUG os_brick.utils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3283a5-1644-4bed-b805-65ef3d49636a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb63171-9d2b-4b3a-b41d-43a1eca5df6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f702ba24-cbfc-4616-8648-c0c1ed638166]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d19d97-ccf3-4e2a-99fa-5c073381fff4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:05:00 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 13:05:00 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[83155d3f-68ad-40c3-9362-dbb95d1ed369]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG os_brick.utils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:05:00 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating existing volume attachment record: b0533863-acc4-4062-98a8-6face02d44b5 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 13:05:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:13 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDeBPFMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:05:19 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:05:19 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:05:19 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af2ede2-3951-49b3-a935-bdcadb198418]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 13:05:19 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8869bcf-259b-4f3f-99b2-c008095b6530]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d] added
Nov 02 13:05:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927cd9d-2415-42c5-876f-c50dfacc1ec7]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d672a98-1b02-4e23-8343-ae6c6cfc5e02]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDeBPFMp {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDeBPFMp" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeb8359-1910-4942-8cbe-6dd049e71650]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xDeBPFMp'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee08209-43ec-4d8f-af27-2706baa1ad87]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c1bef0-ae77-48d6-9e40-7fb21d21c842]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:05:19 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:05:19 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:05:19 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 13:05:19 user nova-compute[74534]: 
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[175b398d-3643-4a45-8946-1a36a868037c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260]
Nov 02 13:05:19 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260] successful.
Nov 02 13:05:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e0c644-4417-4b5f-a309-4d7b4c800730]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[498d41e2-7cff-4775-8f73-6b4282c0786d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d (non-flash)
Nov 02 13:05:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d (non-flash)
Nov 02 13:05:19 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9fdef-d219-40e8-8a72-89a6c486aa5f]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 13:05:19 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDeBPFMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23139396666396334', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139396666396334', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG nova.objects.instance [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 13:05:20 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:05:20 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:05:20 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:05:20 user nova-compute[74534]:   <serial>c86fbaed-4361-499e-8f37-9f6b5bbb6b1d</serial>
Nov 02 13:05:20 user nova-compute[74534]: </disk>
Nov 02 13:05:20 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No VIF found with MAC fa:16:3e:ac:d0:15, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 13:05:20 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-3eaf9faa-16ae-45b2-8531-62990acb86f5 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.509s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:05:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:05:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:34 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:39 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:42 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:44 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:05:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:05:49 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:05:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:05:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:05:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:05:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:05:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:05:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:05:56 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:05:56 user nova-compute[74534]: INFO nova.compute.manager [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Detaching volume c86fbaed-4361-499e-8f37-9f6b5bbb6b1d
Nov 02 13:05:56 user nova-compute[74534]: INFO nova.virt.block_device [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attempting to driver detach volume c86fbaed-4361-499e-8f37-9f6b5bbb6b1d from mountpoint /dev/vdb
Nov 02 13:05:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Attempting to detach device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 13:05:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:05:56 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:05:56 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:05:56 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:05:56 user nova-compute[74534]:   <serial>c86fbaed-4361-499e-8f37-9f6b5bbb6b1d</serial>
Nov 02 13:05:56 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:05:56 user nova-compute[74534]: </disk>
Nov 02 13:05:56 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:05:56 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config.
Nov 02 13:05:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 13:05:56 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:05:56 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:05:56 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:05:56 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:05:56 user nova-compute[74534]:   <serial>c86fbaed-4361-499e-8f37-9f6b5bbb6b1d</serial>
Nov 02 13:05:56 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:05:56 user nova-compute[74534]: </disk>
Nov 02 13:05:56 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:05:57 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:06:00 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:06:00 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.876819610595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:06:00 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:06:01 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:06:01 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:06:01 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:06:01 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:06:01 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:06:01 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:06:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:06:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:06:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:14 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:06:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:17 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b is timed out.
Nov 02 13:06:17 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config.
Nov 02 13:06:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDeBPFMp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:06:17 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c56672-0122-46c2-8226-a7ed8e904c45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 13:06:17 user nova-compute[74534]: No targets found.
Nov 02 13:06:17 user nova-compute[74534]: iSNS:
Nov 02 13:06:17 user nova-compute[74534]: No targets found.
Nov 02 13:06:17 user nova-compute[74534]: STATIC:
Nov 02 13:06:17 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d
Nov 02 13:06:17 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 13:06:17 user nova-compute[74534]:                 Iface Name: default
Nov 02 13:06:17 user nova-compute[74534]: FIRMWARE:
Nov 02 13:06:17 user nova-compute[74534]: No targets found.
Nov 02 13:06:17 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 13:06:17 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 13:06:17 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d148518-c422-45c7-90c6-3907e0509a1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0597dc8d-e898-42e3-84d8-f98d49de25f0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d (non-flash)
Nov 02 13:06:17 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d (non-flash)
Nov 02 13:06:17 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180521d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6def31-f4d8-4ab0-981a-cdf096bac8af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[310615b0-62d3-4bef-8a7a-ca5ff3b43e68]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a909c526-5e17-46b4-9d20-de67d50bca08]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc531d6-3e9e-476a-9cd2-ea0501b1eafc]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065fc08-8f74-447c-9100-10059b5cdc2b]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764c1e7-36ae-44d6-a1c8-86ebce09c07d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260]
Nov 02 13:06:17 user nova-compute[74534]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d, portal: 172.16.0.220,3260] successful.
Nov 02 13:06:17 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c86fbaed-4361-499e-8f37-9f6b5bbb6b1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a32c2a-d91d-4b08-ac45-546556ad8895]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== disconnect_volume: return (293ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:06:17 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 13:06:18 user nova-compute[74534]: DEBUG nova.objects.instance [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:06:18 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-43fa99a0-8ec7-495c-9c91-09a9e243ca05 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:06:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:26 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:06:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:06:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:06:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:45 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:06:47 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:47 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:06:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:06:50 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:06:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:06:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:06:51 user nova-compute[74534]: DEBUG nova.objects.instance [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:06:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:06:51 user nova-compute[74534]: INFO nova.compute.manager [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attaching volume d3e595f5-c9fa-4239-97fb-94f4c5289647 to /dev/vdb
Nov 02 13:06:52 user nova-compute[74534]: DEBUG os_brick.utils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd01db0-6486-49a3-b8a5-a7e58ded13ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39d174-ecfa-4dad-aba1-628041482191]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7851ab-5aa3-4686-9098-3d2033620fe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1101e1-2b73-438c-b155-1fa180466a03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:06:52 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[758e2237-93c4-439d-843e-b634119900b2]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG os_brick.utils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating existing volume attachment record: 9afc55a1-36aa-41a4-8827-421aadf999c0 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 13:06:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:06:54 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:06:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:02 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:03 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:07:03 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:07:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=24.87604522705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:07:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:07:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:07:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:11 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 13:07:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 13:07:11 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 13:07:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNbfzcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:07:20 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:07:20 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:07:20 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee82480-f285-44ea-93c5-9045756ce2f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 13:07:20 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[75377cc3-4a1c-4824-b955-d885e831b2f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647] added
Nov 02 13:07:20 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee5a346-1617-440b-a0b2-96e19e58c32f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[80294b19-9895-4870-84a1-f463eacf8f9f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNbfzcSp {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNbfzcSp" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984f79d-1252-4b84-bc46-b39f8fcd0fd1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xNbfzcSp'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5528c90b-83de-466a-9d5d-c72a00f2d0e2]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8539c2-83c7-4e19-bca3-ba9830fd2ed2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:07:20 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:07:20 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:07:20 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 13:07:20 user nova-compute[74534]: 
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8494c97-8794-484a-973b-53853c74f44c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:20 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260]
Nov 02 13:07:20 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260] successful.
Nov 02 13:07:20 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8852707-75eb-4edd-ad36-13fdfe60f39f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd1839-44b6-42c5-b1e6-c27810ec651c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 (non-flash)
Nov 02 13:07:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 (non-flash)
Nov 02 13:07:21 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee52084-f367-449c-8371-c26a1ccfc43a]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 13:07:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNbfzcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26561663435326135', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561663435326135', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG nova.objects.instance [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 13:07:22 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:07:22 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:07:22 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:07:22 user nova-compute[74534]:   <serial>d3e595f5-c9fa-4239-97fb-94f4c5289647</serial>
Nov 02 13:07:22 user nova-compute[74534]: </disk>
Nov 02 13:07:22 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No VIF found with MAC fa:16:3e:ac:d0:15, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 13:07:22 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-631b4c1a-7efa-4d57-baaa-420bc1cc3d23 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.688s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:07:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:07:24 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:07:24 user nova-compute[74534]: INFO nova.compute.manager [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Detaching volume d3e595f5-c9fa-4239-97fb-94f4c5289647
Nov 02 13:07:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:24 user nova-compute[74534]: INFO nova.virt.block_device [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attempting to driver detach volume d3e595f5-c9fa-4239-97fb-94f4c5289647 from mountpoint /dev/vdb
Nov 02 13:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Attempting to detach device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 13:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:07:24 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:07:24 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:07:24 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:07:24 user nova-compute[74534]:   <serial>d3e595f5-c9fa-4239-97fb-94f4c5289647</serial>
Nov 02 13:07:24 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:07:24 user nova-compute[74534]: </disk>
Nov 02 13:07:24 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:07:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config.
Nov 02 13:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 13:07:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:07:24 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:07:24 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:07:24 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:07:24 user nova-compute[74534]:   <serial>d3e595f5-c9fa-4239-97fb-94f4c5289647</serial>
Nov 02 13:07:24 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:07:24 user nova-compute[74534]: </disk>
Nov 02 13:07:24 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:07:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:25 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 13:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:07:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:37 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:45 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b is timed out.
Nov 02 13:07:45 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config.
Nov 02 13:07:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNbfzcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:07:45 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[218879d2-735f-4e0b-bc6e-e84fc6a77c32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 13:07:45 user nova-compute[74534]: No targets found.
Nov 02 13:07:45 user nova-compute[74534]: iSNS:
Nov 02 13:07:45 user nova-compute[74534]: No targets found.
Nov 02 13:07:45 user nova-compute[74534]: STATIC:
Nov 02 13:07:45 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647
Nov 02 13:07:45 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 13:07:45 user nova-compute[74534]:                 Iface Name: default
Nov 02 13:07:45 user nova-compute[74534]: FIRMWARE:
Nov 02 13:07:45 user nova-compute[74534]: No targets found.
Nov 02 13:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 13:07:45 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 13:07:45 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f086a7-f269-4735-956b-ae50db8b67fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a2fd19-dbdf-439e-9cdf-448c9294fed0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 (non-flash)
Nov 02 13:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 (non-flash)
Nov 02 13:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe15c5b3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673187f-b5c6-48be-b891-ab5b82164c22]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a3b3c4-f361-47bf-9d42-79e0ff8292f2]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6631813-bb3c-4fb7-840b-23b6b341ae09]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e846f9-2caa-48a6-96de-e261dc025399]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d99d03-58c0-4273-af34-17071443e55e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c356263-d2d0-4f1f-8c6e-44bb159ddc48]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260]
Nov 02 13:07:45 user nova-compute[74534]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647, portal: 172.16.0.220,3260] successful.
Nov 02 13:07:45 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e595f5-c9fa-4239-97fb-94f4c5289647 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0026c1a-078b-4143-b3a8-5828a45c8a4d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== disconnect_volume: return (299ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:07:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 13:07:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:46 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:07:46 user nova-compute[74534]: DEBUG nova.objects.instance [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:07:46 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-392940a1-3355-47f3-bfb0-f82ac251919b tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.799s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:07:49 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:07:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:07:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:07:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:07:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:03 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:08:03 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:08:03 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=24.875137329101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:08:03 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:08:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:08:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:08:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:08:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:08:21 user nova-compute[74534]: INFO nova.compute.manager [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attaching volume 4d8663d3-f3ea-496c-9c56-adbb24a9a024 to /dev/vdb
Nov 02 13:08:21 user nova-compute[74534]: DEBUG os_brick.utils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fc8f40-f270-4697-a2f9-56335ac4607a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c6fcd-5ea7-4af8-9563-a49bf3db1c2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2e52f9-d59a-4286-86be-c77edcc713ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f94db9-904b-4b38-bbe0-18360513a2c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:08:21 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 13:08:21 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac926da0-c534-441f-8d72-c4119b90c8af]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG os_brick.utils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:08:21 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating existing volume attachment record: f56829ea-c8f0-4150-a34c-b161c5be9728 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 13:08:24 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:29 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:08:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'koQAOnUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:08:40 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:08:40 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:08:40 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffde2d-727d-44b7-9271-64147a9ef91b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 13:08:40 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[058aef59-bfea-4e59-bddd-1e5d8d896c73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024] added
Nov 02 13:08:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee4d89-cc9d-4354-92a1-0e97e63d630e]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d70db-b304-4ed0-92d6-b6c6d48763f1]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v koQAOnUp {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v koQAOnUp" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bfb141-5805-4a29-9750-01fabab80d6d]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'koQAOnUp'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[581f9025-f0be-4c19-9d46-ff41719f218f]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43051c7-8694-4e49-bfea-71fa7af3b589]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:08:40 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:08:40 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:08:40 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 13:08:40 user nova-compute[74534]: 
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe19aaa7-f42f-4635-8948-d119bb604b14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260]
Nov 02 13:08:40 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260] successful.
Nov 02 13:08:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[15768bbc-a61e-4f1c-aadf-1492ed8a72ce]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f739997a-9b35-4c52-bb4c-d89eb8671ed8]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 (non-flash)
Nov 02 13:08:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 (non-flash)
Nov 02 13:08:40 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b8f84f-24fb-495f-a69a-4d97d776b1f7]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:08:40 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'koQAOnUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23162383932633638', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162383932633638', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 13:08:41 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:08:41 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:08:41 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:08:41 user nova-compute[74534]:   <serial>4d8663d3-f3ea-496c-9c56-adbb24a9a024</serial>
Nov 02 13:08:41 user nova-compute[74534]: </disk>
Nov 02 13:08:41 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No VIF found with MAC fa:16:3e:ac:d0:15, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 13:08:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1c5529b0-9f15-4e42-848b-832a6bee49a2 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.542s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:08:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:08:44 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:08:44 user nova-compute[74534]: INFO nova.compute.manager [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Detaching volume 4d8663d3-f3ea-496c-9c56-adbb24a9a024
Nov 02 13:08:44 user nova-compute[74534]: INFO nova.virt.block_device [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attempting to driver detach volume 4d8663d3-f3ea-496c-9c56-adbb24a9a024 from mountpoint /dev/vdb
Nov 02 13:08:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Attempting to detach device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 13:08:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:08:44 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:08:44 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:08:44 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:08:44 user nova-compute[74534]:   <serial>4d8663d3-f3ea-496c-9c56-adbb24a9a024</serial>
Nov 02 13:08:44 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:08:44 user nova-compute[74534]: </disk>
Nov 02 13:08:44 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:08:44 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config.
Nov 02 13:08:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 13:08:44 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:08:44 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:08:44 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:08:44 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:08:44 user nova-compute[74534]:   <serial>4d8663d3-f3ea-496c-9c56-adbb24a9a024</serial>
Nov 02 13:08:44 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:08:44 user nova-compute[74534]: </disk>
Nov 02 13:08:44 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:08:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:45 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 13:08:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:08:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:08:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:08:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:08:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:08:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:08:53 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:08:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:09:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b is timed out.
Nov 02 13:09:05 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config.
Nov 02 13:09:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'koQAOnUp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:09:05 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d8e1ba-9a46-4ee9-b0f5-39c2c2383135]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 13:09:05 user nova-compute[74534]: No targets found.
Nov 02 13:09:05 user nova-compute[74534]: iSNS:
Nov 02 13:09:05 user nova-compute[74534]: No targets found.
Nov 02 13:09:05 user nova-compute[74534]: STATIC:
Nov 02 13:09:05 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024
Nov 02 13:09:05 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 13:09:05 user nova-compute[74534]:                 Iface Name: default
Nov 02 13:09:05 user nova-compute[74534]: FIRMWARE:
Nov 02 13:09:05 user nova-compute[74534]: No targets found.
Nov 02 13:09:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 13:09:05 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 13:09:05 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b5b76e-3135-4086-8b46-f73a87297cb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c922c1ae-5c5f-4cb3-9eeb-ee5b846b92c2]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 (non-flash)
Nov 02 13:09:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 (non-flash)
Nov 02 13:09:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180521990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642a089-e5d9-48e0-95a6-6f40de15b5e7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d56c58-83fb-4d94-b32d-abfcf9631197]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd90dbfb-4027-4313-8e8b-6871fd7578ee]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c02009-932f-428c-a683-f5b90d692d92]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ebbb73-4ea6-4545-b5cb-94cf3c55abd0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b99134-9caf-4d0e-9e11-5c1c661a9cf6]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260]
Nov 02 13:09:05 user nova-compute[74534]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024, portal: 172.16.0.220,3260] successful.
Nov 02 13:09:05 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d8663d3-f3ea-496c-9c56-adbb24a9a024 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a1979-f24b-4172-a630-a455272ed209]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== disconnect_volume: return (354ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:09:05 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:09:05 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=24.874126434326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:09:05 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG nova.objects.instance [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:09:06 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-0a837d41-08d8-4a7c-8486-874e0b34a216 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:09:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:09:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:09:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:09:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG nova.objects.instance [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:09:40 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:09:41 user nova-compute[74534]: INFO nova.compute.manager [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attaching volume 2e1cbd01-a9b4-45ee-9833-6a75ed82af23 to /dev/vdb
Nov 02 13:09:41 user nova-compute[74534]: DEBUG os_brick.utils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95131e2-0da6-4520-8059-783802042b24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:98c8a73b6cef\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1bd12-0893-43a6-b268-f7ab799e8589]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d45842c-4a11-4bad-8e88-9e86477b16e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb112df-327e-4f95-a0b9-a83339f21def]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Running cmd (subprocess): nvme version {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] nvme not present on system {{(pid=74534) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 13:09:41 user nova-compute[74534]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 13:09:41 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e451d8-6bfa-4e58-9b8b-2b3ec3acfa69]: (4, '') {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74534) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.lightos [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] LIGHTOS: no hostnqn found. {{(pid=74534) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG os_brick.utils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:98c8a73b6cef', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:09:41 user nova-compute[74534]: DEBUG nova.virt.block_device [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating existing volume attachment record: e005cd36-9745-4a73-be5b-558dfabd03c3 {{(pid=74534) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 13:09:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:44 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:09:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:48 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:09:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:09:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:09:55 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:09:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Calling os-brick to attach iSCSI Volume {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odUfPOCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:09:59 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:09:59 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:09:59 user nova-compute[74534]: INFO os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f47a3a-2f7e-47fd-9dab-e5b0a55e6614]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 13:09:59 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1452ec-2d96-44e7-8ab6-620fd9f7b6c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23] added\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23] added
Nov 02 13:09:59 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4802327d-2bc0-42af-80b5-05a8bea06b16]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7be52b5-1cfa-4b90-8584-5fe22753eb94]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odUfPOCn {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odUfPOCn" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[70076114-0eb2-4ce1-84f2-d9798a0d33cc]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'odUfPOCn'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb072a06-273d-47d0-b9b5-94193287d131]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[60790a6b-e9ee-4069-8f6d-1acc68dcfc61]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:09:59 user nova-compute[74534]:  {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 13:09:59 user nova-compute[74534]:  {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:09:59 user nova-compute[74534]: WARNING os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 13:09:59 user nova-compute[74534]: 
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --login {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a3b445-0520-4b9e-a769-7c1c0d2ead3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260]
Nov 02 13:09:59 user nova-compute[74534]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260] successful.
Nov 02 13:09:59 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b176f4d0-8dd3-44bd-8da1-1224de29e705]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c051b90b-8e92-45cc-9925-c8c7bf98e18f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 (non-flash)
Nov 02 13:09:59 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 (non-flash)
Nov 02 13:09:59 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to 172.16.0.220:3260 {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74534) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74534) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3855d44-9ebb-4265-b64f-0d6236f8321f]: (4, ('- - 0', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74534) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 13:09:59 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odUfPOCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74534) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23865666539393735', 'path': '/dev/sdb'} {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865666539393735', 'path': '/dev/sdb'} {{(pid=74534) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG nova.objects.instance [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:10:00 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 13:10:00 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:10:00 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:10:00 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:10:00 user nova-compute[74534]:   <serial>2e1cbd01-a9b4-45ee-9833-6a75ed82af23</serial>
Nov 02 13:10:00 user nova-compute[74534]: </disk>
Nov 02 13:10:00 user nova-compute[74534]:  {{(pid=74534) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 13:10:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:10:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74534) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 13:10:01 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] No VIF found with MAC fa:16:3e:ac:d0:15, not building metadata {{(pid=74534) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 13:10:01 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-24a1f4b3-f574-41f7-90ee-c83f86742ef8 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.309s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:10:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:10:04 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:10:04 user nova-compute[74534]: INFO nova.compute.manager [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Detaching volume 2e1cbd01-a9b4-45ee-9833-6a75ed82af23
Nov 02 13:10:04 user nova-compute[74534]: INFO nova.virt.block_device [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Attempting to driver detach volume 2e1cbd01-a9b4-45ee-9833-6a75ed82af23 from mountpoint /dev/vdb
Nov 02 13:10:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Attempting to detach device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config. {{(pid=74534) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 13:10:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:10:04 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:10:04 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:10:04 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:10:04 user nova-compute[74534]:   <serial>2e1cbd01-a9b4-45ee-9833-6a75ed82af23</serial>
Nov 02 13:10:04 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:10:04 user nova-compute[74534]: </disk>
Nov 02 13:10:04 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:10:04 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the persistent domain config.
Nov 02 13:10:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config. {{(pid=74534) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 13:10:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.guest [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 13:10:04 user nova-compute[74534]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 13:10:04 user nova-compute[74534]:   <source dev="/dev/sdb"/>
Nov 02 13:10:04 user nova-compute[74534]:   <target dev="vdb" bus="virtio"/>
Nov 02 13:10:04 user nova-compute[74534]:   <serial>2e1cbd01-a9b4-45ee-9833-6a75ed82af23</serial>
Nov 02 13:10:04 user nova-compute[74534]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 13:10:04 user nova-compute[74534]: </disk>
Nov 02 13:10:04 user nova-compute[74534]:  {{(pid=74534) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 13:10:04 user nova-compute[74534]: DEBUG nova.virt.libvirt.driver [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 13:10:04 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:07 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:10:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:10:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.873096466064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:10:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:10:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:16 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:24 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b is timed out.
Nov 02 13:10:24 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully detached device vdb from instance 566c5299-a99e-4fb2-a7e9-c64416067c4b from the live domain config.
Nov 02 13:10:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] calling os-brick to detach iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe18038b610>, {'target_iqn': 'iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odUfPOCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 13:10:24 user nova-compute[74534]: WARNING os_brick.initiator.connectors.base [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[157317f7-0b1a-4e6e-b20f-7381d170b2f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 13:10:24 user nova-compute[74534]: No targets found.
Nov 02 13:10:24 user nova-compute[74534]: iSNS:
Nov 02 13:10:24 user nova-compute[74534]: No targets found.
Nov 02 13:10:24 user nova-compute[74534]: STATIC:
Nov 02 13:10:24 user nova-compute[74534]: Target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23
Nov 02 13:10:24 user nova-compute[74534]:         Portal: 172.16.0.220:3260,-1
Nov 02 13:10:24 user nova-compute[74534]:                 Iface Name: default
Nov 02 13:10:24 user nova-compute[74534]: FIRMWARE:
Nov 02 13:10:24 user nova-compute[74534]: No targets found.
Nov 02 13:10:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 13:10:24 user nova-compute[74534]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 13:10:24 user nova-compute[74534]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74534) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23', 0)] {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2575d664-ffa0-4be7-b41b-8076140c9970]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2afab-ffb4-4231-9f7a-07ea8a3de95c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 (non-flash)\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 (non-flash)
Nov 02 13:10:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 (non-flash)
Nov 02 13:10:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe180666440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23'): ({'sdb'}, set())}) {{(pid=74534) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Removing single pathed devices sdb {{(pid=74534) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a114cbf-f8b0-4280-bdba-2588992aaf75]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ed62fc-a104-4e5a-ab58-8b7058ff629a]: (4, ('ok\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Flushing IO for device /dev/sdb {{(pid=74534) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c01d95-46bd-43ce-8fca-ba13a8f70a63]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74534) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[581e9b54-8e90-4ca4-affe-ea6e9fe278c2]: (4, ('1', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.linuxscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] SCSI volumes sdb have been removed. {{(pid=74534) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23')] {{(pid=74534) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c847dc6-6f85-4b64-a6ab-465975acbea5]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --logout {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb1e934-84af-48ae-a44c-09379207bd3c]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260]
Nov 02 13:10:24 user nova-compute[74534]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23, portal: 172.16.0.220,3260] successful.
Nov 02 13:10:24 user nova-compute[74534]:  stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op delete {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1cbd01-a9b4-45ee-9833-6a75ed82af23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73beba7-ff11-4658-948f-fe55a9db1bc0]: (4, ('', '')) {{(pid=86346) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74534) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.base [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG os_brick.initiator.connectors.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] <== disconnect_volume: return (319ms) None {{(pid=74534) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 13:10:24 user nova-compute[74534]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Disconnected iSCSI Volume {{(pid=74534) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG nova.objects.instance [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'flavor' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:10:25 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-35c1916c-1d71-4ddf-b890-10ef70681602 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:10:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:32 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:44 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:48 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:10:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:10:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:10:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:10:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:10:56 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 13:11:08 user nova-compute[74534]: DEBUG oslo_concurrency.processutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74534) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 13:11:09 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:11:09 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:11:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=24.87230682373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:11:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:11:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:10 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:15 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:20 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:25 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:30 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:35 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:40 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:45 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:50 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:11:50 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:11:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquired lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Forcefully refreshing network info cache for instance {{(pid=74534) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG nova.objects.instance [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lazy-loading 'info_cache' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG nova.network.neutron [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [{"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Releasing lock "refresh_cache-566c5299-a99e-4fb2-a7e9-c64416067c4b" {{(pid=74534) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 13:11:52 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updated the network info_cache for instance {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 13:11:55 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:11:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances with incomplete migration  {{(pid=74534) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:12:00 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:12:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:12:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:12:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:07 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:07 user nova-compute[74534]: INFO nova.compute.manager [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Terminating instance
Nov 02 13:12:07 user nova-compute[74534]: DEBUG nova.compute.manager [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Start destroying the instance on the hypervisor. {{(pid=74534) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 13:12:07 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-d8206bbf-3513-4b7a-beff-870faef08a73 req-ae46939c-fb2f-4b3c-bc0f-81a4e3f7ad4f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-unplugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d8206bbf-3513-4b7a-beff-870faef08a73 req-ae46939c-fb2f-4b3c-bc0f-81a4e3f7ad4f service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d8206bbf-3513-4b7a-beff-870faef08a73 req-ae46939c-fb2f-4b3c-bc0f-81a4e3f7ad4f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-d8206bbf-3513-4b7a-beff-870faef08a73 req-ae46939c-fb2f-4b3c-bc0f-81a4e3f7ad4f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-d8206bbf-3513-4b7a-beff-870faef08a73 req-ae46939c-fb2f-4b3c-bc0f-81a4e3f7ad4f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-unplugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.compute.manager [req-d8206bbf-3513-4b7a-beff-870faef08a73 req-ae46939c-fb2f-4b3c-bc0f-81a4e3f7ad4f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-unplugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with task_state deleting. {{(pid=74534) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [-] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Instance destroyed successfully.
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.objects.instance [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lazy-loading 'resources' on Instance uuid 566c5299-a99e-4fb2-a7e9-c64416067c4b {{(pid=74534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.virt.libvirt.vif [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T13:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1224254039',display_name='tempest-SnapshotDataIntegrityTests-server-1224254039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1224254039',id=52,image_ref='36642543-2106-4841-8acf-2e35b58c4209',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOR7LzVcnm95i4cUjJOltxUVWlyDr6cBCVAgBkb6uLs1mOPSJYexZtSZ2wCAtrPguJwI3VcdOm2Q/peHa9Zjs96EqjpQVQ9PyGdz8GHxVQph8E35lZLHQx2VaMZPlNE+rw==',key_name='tempest-keypair-1411596251',keypairs=<?>,launch_index=0,launched_at=2023-11-02T13:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a5a733dcbaa40ec93a8bc0fbacbfbc9',ramdisk_id='',reservation_id='r-2j74gy1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='36642543-2106-4841-8acf-2e35b58c4209',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1359978142',owner_user_name='tempest-SnapshotDataIntegrityTests-1359978142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T13:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8961284f2d94200ad9991a053a1d27b',uuid=566c5299-a99e-4fb2-a7e9-c64416067c4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Converting VIF {"id": "c87f954e-9448-4fcb-a440-9ae6768158ba", "address": "fa:16:3e:ac:d0:15", "network": {"id": "2d15ad29-ec64-4b32-88b6-d024bcd86380", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2033726262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a5a733dcbaa40ec93a8bc0fbacbfbc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87f954e-94", "ovs_interfaceid": "c87f954e-9448-4fcb-a440-9ae6768158ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.network.os_vif_util [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d0:15,bridge_name='br-int',has_traffic_filtering=True,id=c87f954e-9448-4fcb-a440-9ae6768158ba,network=Network(2d15ad29-ec64-4b32-88b6-d024bcd86380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87f954e-94') {{(pid=74534) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG os_vif [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d0:15,bridge_name='br-int',has_traffic_filtering=True,id=c87f954e-9448-4fcb-a440-9ae6768158ba,network=Network(2d15ad29-ec64-4b32-88b6-d024bcd86380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87f954e-94') {{(pid=74534) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc87f954e-94, bridge=br-int, if_exists=True) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=365ecabb-1d4e-460e-a598-701973f8ea72) {{(pid=74534) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:08 user nova-compute[74534]: INFO os_vif [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:d0:15,bridge_name='br-int',has_traffic_filtering=True,id=c87f954e-9448-4fcb-a440-9ae6768158ba,network=Network(2d15ad29-ec64-4b32-88b6-d024bcd86380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87f954e-94')
Nov 02 13:12:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Deleting instance files /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b_del
Nov 02 13:12:08 user nova-compute[74534]: INFO nova.virt.libvirt.driver [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Deletion of /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b_del complete
Nov 02 13:12:08 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000034, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/566c5299-a99e-4fb2-a7e9-c64416067c4b/disk
Nov 02 13:12:08 user nova-compute[74534]: INFO nova.compute.manager [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 02 13:12:08 user nova-compute[74534]: DEBUG oslo.service.loopingcall [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74534) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.compute.manager [-] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Deallocating network for instance {{(pid=74534) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 13:12:08 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] deallocate_for_instance() {{(pid=74534) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 13:12:09 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:12:09 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9073MB free_disk=24.871292114257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Instance 566c5299-a99e-4fb2-a7e9-c64416067c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74534) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:09 user nova-compute[74534]: DEBUG nova.network.neutron [-] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Updating instance_info_cache with network_info: [] {{(pid=74534) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 13:12:09 user nova-compute[74534]: INFO nova.compute.manager [-] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Took 1.18 seconds to deallocate network for instance.
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-b710af8b-c7f0-446a-a079-a97c9fee01d7 req-0bf412fe-f8d5-4052-a37b-bfc12f87223b service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-deleted-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:10 user nova-compute[74534]: INFO nova.scheduler.client.report [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Deleted allocations for instance 566c5299-a99e-4fb2-a7e9-c64416067c4b
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-1b4df028-6856-4cb2-8b4c-d5faad65b2a1 tempest-SnapshotDataIntegrityTests-1359978142 tempest-SnapshotDataIntegrityTests-1359978142-project-member] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:12:10 user nova-compute[74534]: WARNING nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received unexpected event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with vm_state deleted and task_state None.
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:12:10 user nova-compute[74534]: WARNING nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received unexpected event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with vm_state deleted and task_state None.
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:12:10 user nova-compute[74534]: WARNING nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received unexpected event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with vm_state deleted and task_state None.
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-unplugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-unplugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:12:10 user nova-compute[74534]: WARNING nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received unexpected event network-vif-unplugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with vm_state deleted and task_state None.
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Acquiring lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] Lock "566c5299-a99e-4fb2-a7e9-c64416067c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:12:10 user nova-compute[74534]: DEBUG nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] No waiting events found dispatching network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba {{(pid=74534) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 13:12:10 user nova-compute[74534]: WARNING nova.compute.manager [req-a1d9c0d9-32d4-4a45-827a-255087e5ec94 req-1c9700d5-bc30-4df0-8a89-cc423fa5810f service nova] [instance: 566c5299-a99e-4fb2-a7e9-c64416067c4b] Received unexpected event network-vif-plugged-c87f954e-9448-4fcb-a440-9ae6768158ba for instance with vm_state deleted and task_state None.
Nov 02 13:12:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:15 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Cleaning up deleted instances {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 13:12:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] There are 1 instances to clean {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 13:12:15 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] [instance: 603e50c9-4dd5-4f4c-a00a-fe5af8cd8f76] Instance has had 5 of 5 cleanup attempts {{(pid=74534) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 13:12:17 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:33 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:34 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:38 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:43 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._sync_power_states {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:43 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:45 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:46 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:48 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:51 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:51 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74534) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 13:12:52 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 13:12:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74534) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 13:12:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:12:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74534) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 13:12:53 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:54 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Starting heal instance info cache {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 13:12:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Rebuilding the list of instances to heal {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 13:12:54 user nova-compute[74534]: DEBUG nova.compute.manager [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Didn't find any instances for network info cache update. {{(pid=74534) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 13:12:58 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:12:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:12:58 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:01 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:13:02 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:03 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:05 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:08 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager.update_available_resource {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Auditing locally available compute resources for user (node: user) {{(pid=74534) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 13:13:10 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:13:10 user nova-compute[74534]: WARNING nova.virt.libvirt.driver [None req-e8714371-cb92-4681-8db4-880741d0466e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Hypervisor/Node resource view: name=user free_ram=9221MB free_disk=24.89736557006836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74534) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74534) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing inventories for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating ProviderTree inventory for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Updating inventory in ProviderTree for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing aggregate associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, aggregates: None {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Refreshing trait associations for resource provider 3caa4a25-2a24-4d3a-8922-6168a63361d5, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=74534) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.compute.provider_tree [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed in ProviderTree for provider: 3caa4a25-2a24-4d3a-8922-6168a63361d5 {{(pid=74534) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.scheduler.client.report [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Inventory has not changed for provider 3caa4a25-2a24-4d3a-8922-6168a63361d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74534) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG nova.compute.resource_tracker [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Compute_service record updated for user:user {{(pid=74534) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 13:13:10 user nova-compute[74534]: DEBUG oslo_concurrency.lockutils [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=74534) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 13:13:13 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:18 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:18 user nova-compute[74534]: DEBUG oslo_service.periodic_task [None req-e8714371-cb92-4681-8db4-880741d0466e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74534) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 13:13:23 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 13:13:28 user nova-compute[74534]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74534) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}